Jul 02 14:48:12.555957 ip-10-0-128-44 systemd[1]: Starting Kubernetes Kubelet... Jul 02 14:48:12.983561 ip-10-0-128-44 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:12.983561 ip-10-0-128-44 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 14:48:12.983561 ip-10-0-128-44 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:12.983561 ip-10-0-128-44 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 14:48:12.983561 ip-10-0-128-44 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:12.984057 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.983585 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 14:48:12.988457 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988440 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:12.988457 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988457 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988460 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988464 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988467 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988469 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988472 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988474 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988477 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988480 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988484 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988488 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988491 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988497 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988501 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988503 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988506 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988509 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988511 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988514 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:12.988530 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988516 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988519 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988521 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988523 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988526 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988528 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988531 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988534 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988536 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988539 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988542 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988544 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988547 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988549 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988551 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988554 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988557 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988559 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988561 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988564 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:12.988996 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988566 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988568 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988571 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988573 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988576 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988578 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988581 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988584 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988588 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988590 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988592 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988595 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988597 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988599 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988602 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988605 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988608 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988610 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988613 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988615 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:12.989512 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988618 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988620 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988622 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988625 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988627 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988629 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988632 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988635 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988638 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988640 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988643 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988659 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988663 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988667 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988672 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988675 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988678 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988681 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988684 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:12.990014 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988688 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988691 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988693 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988697 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988699 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988702 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988704 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988707 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988710 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988712 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988715 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988718 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988720 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988723 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988725 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988729 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988732 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988735 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988738 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.988740 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:12.990467 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989433 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989440 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989442 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989446 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989448 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989451 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989453 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989456 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989458 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989461 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989463 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989466 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989468 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989471 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989474 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989476 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989479 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989482 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989484 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:12.990971 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989488 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989491 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989493 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989496 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989499 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989502 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989504 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989507 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989509 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989512 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989514 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989517 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989520 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989522 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989525 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989527 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989530 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989533 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989535 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989538 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:12.991442 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989540 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989543 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989545 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989548 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989550 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989552 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989555 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989558 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989560 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989563 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989566 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989568 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989571 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989573 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989576 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989578 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989582 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989584 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989588 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:12.991980 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989592 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989595 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989597 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989600 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989602 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989605 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989607 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989609 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989612 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989615 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989617 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989619 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989622 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989624 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989627 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989629 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989631 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989634 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989636 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989638 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:12.992447 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989642 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989670 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989677 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989682 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989686 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989692 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989695 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989704 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989707 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989710 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989712 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989715 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989717 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989720 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989723 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989726 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989730 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989732 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989735 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989737 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:12.992953 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.989740 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990110 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990115 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990119 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990121 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990124 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990127 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990129 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990132 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990134 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990137 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990140 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990142 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990145 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990148 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990150 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990153 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990157 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990160 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:12.993448 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990163 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990165 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990168 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990170 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990174 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990176 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990179 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990181 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990184 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990186 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990188 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990191 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990193 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990196 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990198 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990201 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990203 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990206 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990208 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990211 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:12.993928 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990213 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990217 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990222 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990225 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990228 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990230 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990233 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990236 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990239 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990241 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990244 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990247 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990249 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990252 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990254 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990256 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990259 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990261 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990264 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990266 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:12.994396 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990269 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990271 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990273 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990276 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990278 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990281 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990284 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990286 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990289 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990291 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990294 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990297 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990299 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990301 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990305 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990308 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990311 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990313 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990315 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990318 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:12.994988 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990321 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990324 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990326 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990328 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990331 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990333 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990336 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990338 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990340 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990343 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990345 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990348 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990350 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990354 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990357 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990360 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990362 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990365 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990367 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990369 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:12.995471 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.990372 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990439 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990445 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990451 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990455 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990459 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990463 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990467 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990472 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990475 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990478 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990483 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990486 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990490 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990492 2559 flags.go:64] FLAG: --cgroup-root="" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990495 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990498 2559 flags.go:64] FLAG: --client-ca-file="" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990501 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990503 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990507 2559 flags.go:64] FLAG: --cluster-domain="" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990509 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990512 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990515 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990518 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 14:48:12.995978 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990522 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990524 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990527 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990530 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990533 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990535 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990538 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990541 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990544 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990548 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990551 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990553 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990556 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990558 2559 flags.go:64] FLAG: --enable-server="true" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990563 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990567 2559 flags.go:64] FLAG: --event-burst="100" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990570 2559 flags.go:64] FLAG: --event-qps="50" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990572 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990575 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990579 2559 flags.go:64] FLAG: --eviction-hard="" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990583 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990585 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990589 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990592 2559 flags.go:64] FLAG: --eviction-soft="" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990595 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 14:48:12.996548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990598 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990600 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990603 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990606 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990609 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990611 2559 flags.go:64] FLAG: --feature-gates="" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990615 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990617 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990620 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990623 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990626 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990628 2559 flags.go:64] FLAG: --help="false" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990631 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-128-44.ec2.internal" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990634 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990636 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990639 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990642 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990661 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990666 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990669 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990672 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990676 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990678 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990681 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 14:48:12.997216 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990684 2559 flags.go:64] FLAG: --kube-reserved="" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990687 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990690 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990693 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990696 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990699 2559 flags.go:64] FLAG: --lock-file="" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990702 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990705 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990708 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990713 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990716 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990719 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990721 2559 flags.go:64] FLAG: --logging-format="text" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990724 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990727 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990729 2559 flags.go:64] FLAG: --manifest-url="" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990732 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990736 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990738 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990743 2559 flags.go:64] FLAG: --max-pods="110" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990745 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990748 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990751 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990753 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990757 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 14:48:12.997838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990759 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990762 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990768 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990771 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990775 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990778 2559 flags.go:64] FLAG: --pod-cidr="" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990781 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990786 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990789 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990792 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990796 2559 flags.go:64] FLAG: --port="10250" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990798 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990801 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061da479236c95458" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990804 2559 flags.go:64] FLAG: --qos-reserved="" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990807 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990810 2559 flags.go:64] FLAG: --register-node="true" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990813 2559 flags.go:64] FLAG: --register-with-taints="" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990816 2559 flags.go:64] FLAG: --registry-burst="10" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990819 2559 flags.go:64] FLAG: --registry-qps="5" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990822 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990824 2559 flags.go:64] FLAG: --reserved-memory="" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990828 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990831 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990833 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990836 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 14:48:12.998740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990838 2559 flags.go:64] FLAG: --runonce="false" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990841 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990844 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990846 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990849 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990851 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990854 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990857 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990860 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990862 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990865 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990869 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990871 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990874 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990877 2559 flags.go:64] FLAG: --system-cgroups="" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990879 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990884 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990888 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990890 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990893 2559 flags.go:64] FLAG: --tls-min-version="" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990896 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990899 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990902 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990904 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990907 2559 flags.go:64] FLAG: --v="2" Jul 02 14:48:12.999541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990911 2559 flags.go:64] FLAG: --version="false" Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990914 2559 flags.go:64] FLAG: --vmodule="" Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990917 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.990920 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991037 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991041 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991045 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991048 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991051 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991053 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991057 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991061 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991064 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991067 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991069 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991072 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991074 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991077 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991080 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991083 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:13.000176 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991086 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991088 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991091 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991093 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991097 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991099 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991102 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991104 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991107 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991109 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991112 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991114 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991117 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991119 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991122 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991124 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991126 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991129 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991131 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991133 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:13.000736 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991136 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991138 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991140 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991142 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991145 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991147 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991149 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991152 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991154 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991156 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991159 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991162 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991164 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991167 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991169 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991171 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991174 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991177 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991179 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991181 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:13.001241 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991184 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991186 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991188 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991192 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991194 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991196 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991199 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991202 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991205 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991208 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991210 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991212 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991215 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991217 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991220 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991222 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991224 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991227 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991229 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:13.001783 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991231 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991234 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991236 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991239 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991241 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991243 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991246 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991249 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991252 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991255 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991258 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991260 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991263 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991266 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991268 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991271 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991273 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991277 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991279 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:13.002243 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991281 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991283 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991286 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991288 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:12.991290 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:12.992213 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.000496 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.000514 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.000529 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.000537 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000591 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000595 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000599 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000602 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000605 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:13.002722 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000608 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000610 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000613 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000618 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000621 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000624 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000627 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000630 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000633 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000635 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000638 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000641 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000643 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000663 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000667 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000671 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000675 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000679 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000683 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000687 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:13.003086 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000689 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000692 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000694 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000697 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000700 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000703 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000705 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000708 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000711 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000713 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000716 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000718 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000721 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000723 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000726 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000728 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000731 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000733 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000736 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000738 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:13.003564 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000741 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000744 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000747 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000750 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000752 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000755 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000757 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000759 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000762 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000764 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000767 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000769 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000772 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000774 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000777 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000780 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000782 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000785 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000788 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000791 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:13.004050 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000793 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000796 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000798 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000802 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000806 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000809 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000812 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000814 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000817 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000820 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000824 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000827 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000829 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000831 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000834 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000837 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000839 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000841 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000844 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:13.004532 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000846 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000848 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000851 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000853 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000855 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000858 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000860 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000863 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000866 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000869 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000872 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000874 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000876 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000879 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.000881 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:13.005064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.000886 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001000 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001013 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001016 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001019 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001022 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001025 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001028 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001032 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001036 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001039 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001041 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001044 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001048 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001050 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001053 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001056 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001060 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001062 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:13.005432 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001065 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001067 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001069 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001072 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001074 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001077 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001079 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001082 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001084 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001086 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001089 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001091 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001094 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001096 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001100 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001103 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001105 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001108 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001110 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:13.005896 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001113 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001115 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001117 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001119 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001122 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001124 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001127 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001129 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001132 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001134 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001137 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001139 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001141 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001144 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001146 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001148 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001151 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001153 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001156 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001158 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:13.006349 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001160 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001163 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001165 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001167 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001170 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001172 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001175 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001177 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001179 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001181 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001184 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001186 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001188 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001191 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001193 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001195 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001197 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001200 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001202 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001205 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:13.006826 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001207 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001209 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001212 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001214 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001217 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001219 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001221 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001223 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001226 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001228 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001231 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001233 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001235 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001238 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001240 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001243 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001245 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001248 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001251 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:13.007312 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001253 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:13.007786 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001256 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:13.007786 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:13.001259 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:13.007786 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.001264 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:13.007786 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.001361 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 14:48:13.009304 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.009289 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 14:48:13.010964 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.010953 2559 server.go:1019] "Starting client certificate rotation" Jul 02 14:48:13.011073 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.011055 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:48:13.011111 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.011089 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:48:13.013644 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.013631 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:48:13.014951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.014922 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:48:13.023104 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.023087 2559 log.go:25] "Validated CRI v1 runtime API" Jul 02 14:48:13.026312 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.026298 2559 log.go:25] "Validated CRI v1 image API" Jul 02 14:48:13.027174 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.027155 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 14:48:13.029783 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.029765 2559 fs.go:135] Filesystem UUIDs: map[16b634b8-d37b-4af8-afc7-e90ce63a52f3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 886b1fb8-c977-4cfb-a3f5-9b58f0f50516:/dev/nvme0n1p4] Jul 02 14:48:13.029861 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.029782 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 14:48:13.036203 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.036107 2559 manager.go:216] Machine: {Timestamp:2026-07-02 14:48:13.035602637 +0000 UTC m=+0.372659396 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100196 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee96fef35139502e742102800ecd7 SystemUUID:ec2ee96f-ef35-1395-02e7-42102800ecd7 BootID:e63d69f0-b8c2-4c4f-b5e2-ea50626ea29b Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:64:07:0a:09:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:64:07:0a:09:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:25:7a:f1:22:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 14:48:13.036203 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.036197 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 14:48:13.036317 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.036265 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 14:48:13.040196 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.040150 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 14:48:13.040518 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.040203 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-44.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 14:48:13.041237 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.041211 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 14:48:13.041237 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.041236 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 14:48:13.041371 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.041247 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:48:13.041371 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.041264 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:48:13.042486 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.042472 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 14:48:13.046747 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.046734 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:48:13.046855 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.046846 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 14:48:13.046901 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.046875 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 02 14:48:13.046901 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.046884 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 14:48:13.046901 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.046894 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 14:48:13.047026 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.046903 2559 kubelet.go:398] "Adding apiserver pod source" Jul 02 14:48:13.047026 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.046912 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 14:48:13.047157 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.047137 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:48:13.047296 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.047284 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:48:13.047335 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.047309 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:48:13.049573 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.049558 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 14:48:13.051470 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.051457 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 14:48:13.051531 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.051487 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 14:48:13.052264 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052253 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052269 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052275 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052280 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052288 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052293 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052305 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052310 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052316 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 14:48:13.052316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052321 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 14:48:13.052558 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052330 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 14:48:13.052558 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.052337 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 14:48:13.053957 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.053945 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 14:48:13.053957 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.053956 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 14:48:13.057058 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.057044 2559 server.go:1268] "Started kubelet" Jul 02 14:48:13.057762 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.057707 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 14:48:13.057857 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.057788 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 14:48:13.057857 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.057851 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-44.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 14:48:13.057996 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.057977 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 14:48:13.058049 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.058002 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 14:48:13.058045 ip-10-0-128-44 systemd[1]: Started Kubernetes Kubelet. Jul 02 14:48:13.058189 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.058165 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 14:48:13.059286 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.059269 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 14:48:13.060533 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.060516 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 02 14:48:13.062995 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.061910 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-44.ec2.internal.18be80697ddf8895 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-44.ec2.internal,UID:ip-10-0-128-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-44.ec2.internal,},FirstTimestamp:2026-07-02 14:48:13.057018005 +0000 UTC m=+0.394074762,LastTimestamp:2026-07-02 14:48:13.057018005 +0000 UTC m=+0.394074762,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-44.ec2.internal,}" Jul 02 14:48:13.063741 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.063722 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 14:48:13.066891 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.066875 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 14:48:13.066953 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.066878 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 14:48:13.067000 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.066971 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.067491 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067476 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 14:48:13.067599 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067479 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 14:48:13.067599 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067526 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 14:48:13.067717 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067662 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 02 14:48:13.067717 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067673 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 02 14:48:13.067717 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067707 2559 factory.go:55] Registering systemd factory Jul 02 14:48:13.067837 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067722 2559 factory.go:223] Registration of the systemd container factory successfully Jul 02 14:48:13.067926 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067916 2559 factory.go:153] Registering CRI-O factory Jul 02 14:48:13.067926 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067927 2559 factory.go:223] Registration of the crio container factory successfully Jul 02 14:48:13.068009 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067973 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 14:48:13.068009 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.067993 2559 factory.go:103] Registering Raw factory Jul 02 14:48:13.068009 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.068006 2559 manager.go:1196] Started watching for new ooms in manager Jul 02 14:48:13.068297 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.068283 2559 manager.go:349] Starting recovery of all containers Jul 02 14:48:13.079551 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.079381 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 14:48:13.080032 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.080013 2559 manager.go:354] Recovery completed Jul 02 14:48:13.085451 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.085438 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:13.087134 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.087116 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:13.087193 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.087147 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:13.087193 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.087157 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:13.087700 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.087681 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 14:48:13.087700 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.087697 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 14:48:13.087872 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.087744 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:48:13.087872 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.087697 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:13.088460 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.088444 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:13.088515 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.088474 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:13.088515 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.088489 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:13.089000 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.088989 2559 policy_none.go:49] "None policy: Start" Jul 02 14:48:13.089048 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.089011 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 14:48:13.089048 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.089023 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 14:48:13.089977 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.089966 2559 policy_none.go:47] "Start" Jul 02 14:48:13.090671 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.090639 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 14:48:13.090750 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.090573 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-44.ec2.internal.18be80697fab0d5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-44.ec2.internal,UID:ip-10-0-128-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-44.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-44.ec2.internal,},FirstTimestamp:2026-07-02 14:48:13.087133021 +0000 UTC m=+0.424189776,LastTimestamp:2026-07-02 14:48:13.087133021 +0000 UTC m=+0.424189776,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-44.ec2.internal,}" Jul 02 14:48:13.096030 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.095967 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-44.ec2.internal.18be80697fab565a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-44.ec2.internal,UID:ip-10-0-128-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-44.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-44.ec2.internal,},FirstTimestamp:2026-07-02 14:48:13.087151706 +0000 UTC m=+0.424208461,LastTimestamp:2026-07-02 14:48:13.087151706 +0000 UTC m=+0.424208461,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-44.ec2.internal,}" Jul 02 14:48:13.097741 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.097724 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-stdl6" Jul 02 14:48:13.101719 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.101638 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-44.ec2.internal.18be80697fab79a4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-44.ec2.internal,UID:ip-10-0-128-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-44.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-44.ec2.internal,},FirstTimestamp:2026-07-02 14:48:13.08716074 +0000 UTC m=+0.424217497,LastTimestamp:2026-07-02 14:48:13.08716074 +0000 UTC m=+0.424217497,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-44.ec2.internal,}" Jul 02 14:48:13.104786 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.104772 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-stdl6" Jul 02 14:48:13.106608 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.106546 2559 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-44.ec2.internal.18be80697fab0d5d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-44.ec2.internal.18be80697fab0d5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-44.ec2.internal,UID:ip-10-0-128-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-44.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-44.ec2.internal,},FirstTimestamp:2026-07-02 14:48:13.087133021 +0000 UTC m=+0.424189776,LastTimestamp:2026-07-02 14:48:13.088459679 +0000 UTC m=+0.425516439,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-44.ec2.internal,}" Jul 02 14:48:13.135626 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.135608 2559 manager.go:337] "Starting Device Plugin manager" Jul 02 14:48:13.135904 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.135665 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 14:48:13.135904 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.135679 2559 server.go:87] "Starting device plugin registration server" Jul 02 14:48:13.151028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.135974 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 14:48:13.151028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.135986 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 14:48:13.151028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.136084 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 14:48:13.151028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.136173 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 14:48:13.151028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.136181 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 14:48:13.151028 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.136704 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 14:48:13.151028 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.136760 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.151028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.150864 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 14:48:13.152233 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.152215 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 14:48:13.152281 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.152265 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 14:48:13.152314 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.152292 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 14:48:13.152356 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.152330 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 14:48:13.154203 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.154158 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:13.236735 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.236634 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:13.237816 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.237798 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:13.237923 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.237834 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:13.237923 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.237849 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:13.237923 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.237875 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.246258 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.246244 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.246298 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.246265 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-44.ec2.internal\": node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.252726 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.252707 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal"] Jul 02 14:48:13.252778 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.252760 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:13.254260 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.254245 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:13.254343 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.254270 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:13.254343 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.254279 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:13.255321 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.255309 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:13.255419 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.255407 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.255465 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.255434 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:13.256017 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.256000 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:13.256097 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.256023 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:13.256097 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.256032 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:13.256097 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.256007 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:13.256193 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.256096 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:13.256193 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.256108 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:13.257191 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.257174 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.257243 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.257207 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:13.257899 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.257880 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:13.257981 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.257914 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:13.257981 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.257929 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:13.269529 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.269509 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7eb21fea108827267dcb75a26b4da5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal\" (UID: \"e7eb21fea108827267dcb75a26b4da5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.269628 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.269533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7eb21fea108827267dcb75a26b4da5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal\" (UID: \"e7eb21fea108827267dcb75a26b4da5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.269628 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.269549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0370d9c46c9da9e1f4e1c6074d7c2819-config\") pod \"kube-apiserver-proxy-ip-10-0-128-44.ec2.internal\" (UID: \"0370d9c46c9da9e1f4e1c6074d7c2819\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.272725 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.272709 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.289353 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.289337 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-44.ec2.internal\" not found" node="ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.293897 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.293883 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-44.ec2.internal\" not found" node="ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.370723 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.370691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7eb21fea108827267dcb75a26b4da5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal\" (UID: \"e7eb21fea108827267dcb75a26b4da5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.370723 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.370727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7eb21fea108827267dcb75a26b4da5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal\" (UID: \"e7eb21fea108827267dcb75a26b4da5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.370944 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.370745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0370d9c46c9da9e1f4e1c6074d7c2819-config\") pod \"kube-apiserver-proxy-ip-10-0-128-44.ec2.internal\" (UID: \"0370d9c46c9da9e1f4e1c6074d7c2819\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.370944 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.370775 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0370d9c46c9da9e1f4e1c6074d7c2819-config\") pod \"kube-apiserver-proxy-ip-10-0-128-44.ec2.internal\" (UID: \"0370d9c46c9da9e1f4e1c6074d7c2819\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.370944 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.370801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7eb21fea108827267dcb75a26b4da5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal\" (UID: \"e7eb21fea108827267dcb75a26b4da5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.370944 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.370801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7eb21fea108827267dcb75a26b4da5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal\" (UID: \"e7eb21fea108827267dcb75a26b4da5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.373774 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.373743 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.474263 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.474224 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.575022 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.574955 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.593057 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.593032 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.598913 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.598897 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" Jul 02 14:48:13.675428 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.675401 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.775925 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.775895 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.876461 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.876384 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.976881 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:13.976851 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-44.ec2.internal\" not found" Jul 02 14:48:13.989837 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:13.989818 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:14.010383 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.010364 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 14:48:14.010496 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.010477 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:48:14.010539 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.010498 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:48:14.047687 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.047669 2559 apiserver.go:52] "Watching apiserver" Jul 02 14:48:14.059324 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.059304 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:14.067668 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.067634 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 14:48:14.067784 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.067637 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" Jul 02 14:48:14.069557 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.069536 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 14:48:14.069903 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.069886 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-jmbqz","kube-system/konnectivity-agent-bqp6z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb","openshift-dns/node-resolver-frcsz","openshift-image-registry/node-ca-wrg9c","openshift-multus/multus-additional-cni-plugins-kg7lv","openshift-multus/network-metrics-daemon-n6vnp","kube-system/global-pull-secret-syncer-4w8l6","openshift-cluster-node-tuning-operator/tuned-9ddsk","openshift-multus/multus-q8k67","openshift-network-diagnostics/network-check-target-hjjfh","openshift-network-operator/iptables-alerter-ktp87"] Jul 02 14:48:14.071219 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.071207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.072229 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.072214 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:14.073507 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.073492 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.075042 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.075026 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.075481 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.075459 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 14:48:14.075541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.075495 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 14:48:14.075541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.075523 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 14:48:14.075675 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.075641 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 14:48:14.075797 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.075696 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 14:48:14.076072 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.076054 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 14:48:14.076170 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.076154 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zmsnh\"" Jul 02 14:48:14.076170 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.076166 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 14:48:14.076266 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.076194 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rs9p2\"" Jul 02 14:48:14.076266 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.076162 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.076266 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.076246 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 14:48:14.077435 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.077419 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.077908 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.077890 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 14:48:14.078011 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.077914 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 14:48:14.078011 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.077917 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 14:48:14.078134 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.078119 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 14:48:14.078226 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.078202 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xsv9l\"" Jul 02 14:48:14.078339 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.078263 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 14:48:14.078339 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.078332 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fhnnm\"" Jul 02 14:48:14.078562 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.078532 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:14.078686 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.078624 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:14.078889 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.078876 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 14:48:14.079571 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.079556 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 14:48:14.079635 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.079612 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-95kgg\"" Jul 02 14:48:14.079712 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.079633 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 14:48:14.079861 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.079848 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.079969 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.079951 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:14.080120 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.080107 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 14:48:14.080324 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.080310 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:48:14.080393 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.080376 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" Jul 02 14:48:14.080444 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.080418 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 14:48:14.081115 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.081103 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.081336 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.081316 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 14:48:14.081410 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.081357 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 14:48:14.081410 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.081380 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rj5sp\"" Jul 02 14:48:14.081475 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.081385 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 14:48:14.082289 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.082274 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.083462 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.083446 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:14.083903 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.083870 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:14.084621 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.084594 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:48:14.084621 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.084614 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 14:48:14.084813 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.084794 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qhdmv\"" Jul 02 14:48:14.084926 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.084907 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:48:14.085355 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.085339 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal"] Jul 02 14:48:14.085473 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.085452 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.085529 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.085506 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v82j7\"" Jul 02 14:48:14.085761 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.085376 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 14:48:14.088680 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.088643 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:48:14.089288 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.089268 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 14:48:14.089400 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.089297 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 14:48:14.089400 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.089273 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nmwvh\"" Jul 02 14:48:14.093378 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.093362 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:48:14.093534 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.093521 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal"] Jul 02 14:48:14.108927 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.108883 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 14:43:13 +0000 UTC" deadline="2027-12-23 15:52:00.498000646 +0000 UTC" Jul 02 14:48:14.108927 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.108926 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12937h3m46.389077335s" Jul 02 14:48:14.110924 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.110908 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jk7w4" Jul 02 14:48:14.117706 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.117691 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jk7w4" Jul 02 14:48:14.168917 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.168886 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 14:48:14.173870 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.173853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5dlx\" (UniqueName: \"kubernetes.io/projected/ddcd4d4d-9542-4915-8715-399662ebc436-kube-api-access-n5dlx\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.173953 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.173885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-cni-bin\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.173953 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.173909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-cni-bin\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.173953 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.173931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-kubelet-config\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.174052 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.173979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-system-cni-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.174052 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174019 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-multus-certs\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.174052 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-var-lib-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174147 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-env-overrides\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174147 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174114 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c426b758-6486-4602-8009-c551664c6a74-serviceca\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.174147 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174133 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87346d39-0870-4761-97a0-4624d223b352-agent-certs\") pod \"konnectivity-agent-bqp6z\" (UID: \"87346d39-0870-4761-97a0-4624d223b352\") " pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:14.174250 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174147 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-sys\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174250 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-netns\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.174250 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-daemon-config\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.174250 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-log-socket\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174250 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovnkube-config\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rz2\" (UniqueName: \"kubernetes.io/projected/6bd50344-c877-4066-8fe6-9e38645f3839-kube-api-access-w6rz2\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174281 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-kubernetes\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174297 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysctl-d\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174311 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-etc-kubernetes\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-etc-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8vv2\" (UniqueName: \"kubernetes.io/projected/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-kube-api-access-p8vv2\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-systemd-units\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-run-netns\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-system-cni-dir\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mm8\" (UniqueName: \"kubernetes.io/projected/035ab302-5ed4-4e18-9962-36620adfebde-kube-api-access-g7mm8\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-lib-modules\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174527 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-modprobe-d\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-kubelet\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174605 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-kubelet\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-ovn\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174666 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c426b758-6486-4602-8009-c551664c6a74-host\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-cnibin\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174719 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysconfig\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysctl-conf\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-run\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-var-lib-kubelet\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-host\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-conf-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.174951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-run-ovn-kubernetes\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-sys-fs\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174902 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-hostroot\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-systemd\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovnkube-script-lib\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-registration-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.174988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d010f319-b874-4149-9bc0-fb9216343efd-host-slash\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175004 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87346d39-0870-4761-97a0-4624d223b352-konnectivity-ca\") pod \"konnectivity-agent-bqp6z\" (UID: \"87346d39-0870-4761-97a0-4624d223b352\") " pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-os-release\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-socket-dir-parent\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175107 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-device-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175202 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-dbus\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.175572 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-systemd\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175247 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-cni-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-socket-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175300 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vbwf\" (UniqueName: \"kubernetes.io/projected/db06ba71-e44a-45f1-b291-7e8f944ce68d-kube-api-access-4vbwf\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddcd4d4d-9542-4915-8715-399662ebc436-tmp\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175350 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-cnibin\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-slash\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s668r\" (UniqueName: \"kubernetes.io/projected/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-kube-api-access-s668r\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsxnn\" (UniqueName: \"kubernetes.io/projected/ef3c9901-8765-4e2f-8304-0f82b0990fe6-kube-api-access-vsxnn\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db06ba71-e44a-45f1-b291-7e8f944ce68d-hosts-file\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-os-release\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-k8s-cni-cncf-io\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovn-node-metrics-cert\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175530 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpprn\" (UniqueName: \"kubernetes.io/projected/d010f319-b874-4149-9bc0-fb9216343efd-kube-api-access-jpprn\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.176063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db06ba71-e44a-45f1-b291-7e8f944ce68d-tmp-dir\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175568 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ddcd4d4d-9542-4915-8715-399662ebc436-etc-tuned\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-cni-netd\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175594 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff2h2\" (UniqueName: \"kubernetes.io/projected/c426b758-6486-4602-8009-c551664c6a74-kube-api-access-ff2h2\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175611 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d010f319-b874-4149-9bc0-fb9216343efd-iptables-alerter-script\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef3c9901-8765-4e2f-8304-0f82b0990fe6-cni-binary-copy\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175671 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-cni-multus\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-node-log\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.176549 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.175698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.276919 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.276888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:14.276919 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.276922 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-kubernetes\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.276937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysctl-d\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.276958 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-etc-kubernetes\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.276979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-etc-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.276995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8vv2\" (UniqueName: \"kubernetes.io/projected/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-kube-api-access-p8vv2\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-systemd-units\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277046 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-kubernetes\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.277066 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-etc-kubernetes\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-run-netns\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277090 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-systemd-units\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysctl-d\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277100 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-run-netns\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277052 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-etc-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-system-cni-dir\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.277201 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.277149 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:48:14.777126283 +0000 UTC m=+2.114183041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277166 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-system-cni-dir\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7mm8\" (UniqueName: \"kubernetes.io/projected/035ab302-5ed4-4e18-9962-36620adfebde-kube-api-access-g7mm8\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-lib-modules\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277257 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-modprobe-d\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277279 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-kubelet\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277311 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-lib-modules\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-kubelet\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277348 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-modprobe-d\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277357 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-kubelet\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-kubelet\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-ovn\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c426b758-6486-4602-8009-c551664c6a74-host\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-ovn\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-cnibin\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277443 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c426b758-6486-4602-8009-c551664c6a74-host\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.278064 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-cnibin\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysconfig\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysconfig\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysctl-conf\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277492 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-run\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-var-lib-kubelet\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-host\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-conf-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-run-ovn-kubernetes\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277582 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-var-lib-kubelet\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-sys-fs\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-host\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277602 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-conf-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-run-ovn-kubernetes\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277623 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-hostroot\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-sysctl-conf\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277636 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-sys-fs\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277669 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-hostroot\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.278937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277668 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-systemd\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277633 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-run\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-systemd\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovnkube-script-lib\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277757 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-registration-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277781 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d010f319-b874-4149-9bc0-fb9216343efd-host-slash\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277801 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-registration-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277804 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87346d39-0870-4761-97a0-4624d223b352-konnectivity-ca\") pod \"konnectivity-agent-bqp6z\" (UID: \"87346d39-0870-4761-97a0-4624d223b352\") " pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277853 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d010f319-b874-4149-9bc0-fb9216343efd-host-slash\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277867 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-os-release\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277891 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-socket-dir-parent\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277954 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-os-release\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-socket-dir-parent\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.279906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.277997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-device-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-device-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278035 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278060 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-dbus\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-systemd\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278060 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-cni-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278143 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-socket-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vbwf\" (UniqueName: \"kubernetes.io/projected/db06ba71-e44a-45f1-b291-7e8f944ce68d-kube-api-access-4vbwf\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278178 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-etc-systemd\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278145 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278195 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddcd4d4d-9542-4915-8715-399662ebc436-tmp\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278214 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-dbus\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278219 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-cnibin\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-slash\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-socket-dir\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.280829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278267 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s668r\" (UniqueName: \"kubernetes.io/projected/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-kube-api-access-s668r\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278286 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovnkube-script-lib\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278191 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-cni-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsxnn\" (UniqueName: \"kubernetes.io/projected/ef3c9901-8765-4e2f-8304-0f82b0990fe6-kube-api-access-vsxnn\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278319 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-slash\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278320 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-cnibin\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278337 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db06ba71-e44a-45f1-b291-7e8f944ce68d-hosts-file\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-os-release\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/87346d39-0870-4761-97a0-4624d223b352-konnectivity-ca\") pod \"konnectivity-agent-bqp6z\" (UID: \"87346d39-0870-4761-97a0-4624d223b352\") " pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278437 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-k8s-cni-cncf-io\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/db06ba71-e44a-45f1-b291-7e8f944ce68d-hosts-file\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bd50344-c877-4066-8fe6-9e38645f3839-os-release\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278476 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.278490 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-k8s-cni-cncf-io\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278518 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-run-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.281627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovn-node-metrics-cert\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.278622 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret podName:d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:14.778604455 +0000 UTC m=+2.115661210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret") pod "global-pull-secret-syncer-4w8l6" (UID: "d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpprn\" (UniqueName: \"kubernetes.io/projected/d010f319-b874-4149-9bc0-fb9216343efd-kube-api-access-jpprn\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db06ba71-e44a-45f1-b291-7e8f944ce68d-tmp-dir\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ddcd4d4d-9542-4915-8715-399662ebc436-etc-tuned\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-cni-netd\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2h2\" (UniqueName: \"kubernetes.io/projected/c426b758-6486-4602-8009-c551664c6a74-kube-api-access-ff2h2\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d010f319-b874-4149-9bc0-fb9216343efd-iptables-alerter-script\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278797 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-cni-netd\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278852 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef3c9901-8765-4e2f-8304-0f82b0990fe6-cni-binary-copy\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-cni-multus\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-node-log\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278940 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5dlx\" (UniqueName: \"kubernetes.io/projected/ddcd4d4d-9542-4915-8715-399662ebc436-kube-api-access-n5dlx\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-cni-bin\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.278986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-cni-bin\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279005 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-kubelet-config\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db06ba71-e44a-45f1-b291-7e8f944ce68d-tmp-dir\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-system-cni-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-multus-certs\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-var-lib-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279088 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-env-overrides\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c426b758-6486-4602-8009-c551664c6a74-serviceca\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87346d39-0870-4761-97a0-4624d223b352-agent-certs\") pod \"konnectivity-agent-bqp6z\" (UID: \"87346d39-0870-4761-97a0-4624d223b352\") " pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-sys\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-netns\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-netns\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279215 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-cni-multus\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-daemon-config\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279275 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-node-log\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-log-socket\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-kubelet-config\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.282847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovnkube-config\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-system-cni-dir\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rz2\" (UniqueName: \"kubernetes.io/projected/6bd50344-c877-4066-8fe6-9e38645f3839-kube-api-access-w6rz2\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279412 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-run-multus-certs\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d010f319-b874-4149-9bc0-fb9216343efd-iptables-alerter-script\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bd50344-c877-4066-8fe6-9e38645f3839-cni-binary-copy\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279254 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef3c9901-8765-4e2f-8304-0f82b0990fe6-host-var-lib-cni-bin\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279828 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-host-cni-bin\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279886 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef3c9901-8765-4e2f-8304-0f82b0990fe6-multus-daemon-config\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279924 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-log-socket\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.279985 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovnkube-config\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.280109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c426b758-6486-4602-8009-c551664c6a74-serviceca\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.280292 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-env-overrides\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.280344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-var-lib-openvswitch\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.280549 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef3c9901-8765-4e2f-8304-0f82b0990fe6-cni-binary-copy\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.280567 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ddcd4d4d-9542-4915-8715-399662ebc436-sys\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.282070 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ddcd4d4d-9542-4915-8715-399662ebc436-tmp\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.282242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-ovn-node-metrics-cert\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.283411 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.282489 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/87346d39-0870-4761-97a0-4624d223b352-agent-certs\") pod \"konnectivity-agent-bqp6z\" (UID: \"87346d39-0870-4761-97a0-4624d223b352\") " pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:14.283928 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.283058 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ddcd4d4d-9542-4915-8715-399662ebc436-etc-tuned\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.284700 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.284680 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:14.284803 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.284704 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:14.284803 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.284717 2559 projected.go:196] Error preparing data for projected volume kube-api-access-th8pw for pod openshift-network-diagnostics/network-check-target-hjjfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:14.284803 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.284786 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw podName:f90acceb-2024-451f-aa60-6e113c598de4 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:14.784770342 +0000 UTC m=+2.121827098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-th8pw" (UniqueName: "kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw") pod "network-check-target-hjjfh" (UID: "f90acceb-2024-451f-aa60-6e113c598de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:14.287354 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.287327 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8vv2\" (UniqueName: \"kubernetes.io/projected/b3b0ee35-fe39-449c-964f-bd291f1fbaf4-kube-api-access-p8vv2\") pod \"ovnkube-node-jmbqz\" (UID: \"b3b0ee35-fe39-449c-964f-bd291f1fbaf4\") " pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.288034 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.288011 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7mm8\" (UniqueName: \"kubernetes.io/projected/035ab302-5ed4-4e18-9962-36620adfebde-kube-api-access-g7mm8\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:14.288333 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.288314 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff2h2\" (UniqueName: \"kubernetes.io/projected/c426b758-6486-4602-8009-c551664c6a74-kube-api-access-ff2h2\") pod \"node-ca-wrg9c\" (UID: \"c426b758-6486-4602-8009-c551664c6a74\") " pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.289076 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.289057 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsxnn\" (UniqueName: \"kubernetes.io/projected/ef3c9901-8765-4e2f-8304-0f82b0990fe6-kube-api-access-vsxnn\") pod \"multus-q8k67\" (UID: \"ef3c9901-8765-4e2f-8304-0f82b0990fe6\") " pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.289251 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.289234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s668r\" (UniqueName: \"kubernetes.io/projected/cc8a477e-5fa0-4332-bf45-bf2c8b42d945-kube-api-access-s668r\") pod \"aws-ebs-csi-driver-node-fwxlb\" (UID: \"cc8a477e-5fa0-4332-bf45-bf2c8b42d945\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.289315 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.289266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vbwf\" (UniqueName: \"kubernetes.io/projected/db06ba71-e44a-45f1-b291-7e8f944ce68d-kube-api-access-4vbwf\") pod \"node-resolver-frcsz\" (UID: \"db06ba71-e44a-45f1-b291-7e8f944ce68d\") " pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.289486 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.289469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rz2\" (UniqueName: \"kubernetes.io/projected/6bd50344-c877-4066-8fe6-9e38645f3839-kube-api-access-w6rz2\") pod \"multus-additional-cni-plugins-kg7lv\" (UID: \"6bd50344-c877-4066-8fe6-9e38645f3839\") " pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.289568 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.289507 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5dlx\" (UniqueName: \"kubernetes.io/projected/ddcd4d4d-9542-4915-8715-399662ebc436-kube-api-access-n5dlx\") pod \"tuned-9ddsk\" (UID: \"ddcd4d4d-9542-4915-8715-399662ebc436\") " pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.290286 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.290270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpprn\" (UniqueName: \"kubernetes.io/projected/d010f319-b874-4149-9bc0-fb9216343efd-kube-api-access-jpprn\") pod \"iptables-alerter-ktp87\" (UID: \"d010f319-b874-4149-9bc0-fb9216343efd\") " pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.318114 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.318074 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0370d9c46c9da9e1f4e1c6074d7c2819.slice/crio-8b49d26fa761abc9538cfc400b9f3416282b7053c730fd9c75b4bba413496a74 WatchSource:0}: Error finding container 8b49d26fa761abc9538cfc400b9f3416282b7053c730fd9c75b4bba413496a74: Status 404 returned error can't find the container with id 8b49d26fa761abc9538cfc400b9f3416282b7053c730fd9c75b4bba413496a74 Jul 02 14:48:14.318332 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.318313 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7eb21fea108827267dcb75a26b4da5c.slice/crio-18dc71eec9f7ab7991586c8e042aa97277220137e66c3a5ddf444ff5b135f957 WatchSource:0}: Error finding container 18dc71eec9f7ab7991586c8e042aa97277220137e66c3a5ddf444ff5b135f957: Status 404 returned error can't find the container with id 18dc71eec9f7ab7991586c8e042aa97277220137e66c3a5ddf444ff5b135f957 Jul 02 14:48:14.322775 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.322758 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:48:14.392877 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.392804 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:14.409866 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.409837 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:14.417809 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.417783 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b0ee35_fe39_449c_964f_bd291f1fbaf4.slice/crio-28072945457b2433ddee42cf62ac522d294c322cb9dd49cbacfaa82cec2a306a WatchSource:0}: Error finding container 28072945457b2433ddee42cf62ac522d294c322cb9dd49cbacfaa82cec2a306a: Status 404 returned error can't find the container with id 28072945457b2433ddee42cf62ac522d294c322cb9dd49cbacfaa82cec2a306a Jul 02 14:48:14.426605 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.426588 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:14.434111 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.434090 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87346d39_0870_4761_97a0_4624d223b352.slice/crio-3a5f45d9d3edd9197712bbc53d4d513d6f21695eaec10dd3086c5963183be14d WatchSource:0}: Error finding container 3a5f45d9d3edd9197712bbc53d4d513d6f21695eaec10dd3086c5963183be14d: Status 404 returned error can't find the container with id 3a5f45d9d3edd9197712bbc53d4d513d6f21695eaec10dd3086c5963183be14d Jul 02 14:48:14.443522 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.443503 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" Jul 02 14:48:14.450825 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.450802 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8a477e_5fa0_4332_bf45_bf2c8b42d945.slice/crio-9f987516a869c4430ac9bfabec29a2d97ce61afefbd5926f9abb17cd4452ce8f WatchSource:0}: Error finding container 9f987516a869c4430ac9bfabec29a2d97ce61afefbd5926f9abb17cd4452ce8f: Status 404 returned error can't find the container with id 9f987516a869c4430ac9bfabec29a2d97ce61afefbd5926f9abb17cd4452ce8f Jul 02 14:48:14.455882 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.455867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-frcsz" Jul 02 14:48:14.464074 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.464050 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb06ba71_e44a_45f1_b291_7e8f944ce68d.slice/crio-443d3e48bfe5b75d85e2d4904024a91e80b10f1ae5bbb18bcbfd7c674c447845 WatchSource:0}: Error finding container 443d3e48bfe5b75d85e2d4904024a91e80b10f1ae5bbb18bcbfd7c674c447845: Status 404 returned error can't find the container with id 443d3e48bfe5b75d85e2d4904024a91e80b10f1ae5bbb18bcbfd7c674c447845 Jul 02 14:48:14.471132 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.471116 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wrg9c" Jul 02 14:48:14.478398 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.478364 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc426b758_6486_4602_8009_c551664c6a74.slice/crio-5d92bf99389d6fe985d3d7060efbec5c4fa4b372549f746dd82a70d70a6ca270 WatchSource:0}: Error finding container 5d92bf99389d6fe985d3d7060efbec5c4fa4b372549f746dd82a70d70a6ca270: Status 404 returned error can't find the container with id 5d92bf99389d6fe985d3d7060efbec5c4fa4b372549f746dd82a70d70a6ca270 Jul 02 14:48:14.486169 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.486151 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" Jul 02 14:48:14.489752 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.489729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" Jul 02 14:48:14.492942 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.492918 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd50344_c877_4066_8fe6_9e38645f3839.slice/crio-f53d13c8eb1c97877e6edb64086942dee7bd092857f2cb15c5b7edd9ebe058eb WatchSource:0}: Error finding container f53d13c8eb1c97877e6edb64086942dee7bd092857f2cb15c5b7edd9ebe058eb: Status 404 returned error can't find the container with id f53d13c8eb1c97877e6edb64086942dee7bd092857f2cb15c5b7edd9ebe058eb Jul 02 14:48:14.497260 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.497242 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddcd4d4d_9542_4915_8715_399662ebc436.slice/crio-aa3561e8011a04459b25097616dba7b513d6c29afefb9d0014fac7e1a43236d5 WatchSource:0}: Error finding container aa3561e8011a04459b25097616dba7b513d6c29afefb9d0014fac7e1a43236d5: Status 404 returned error can't find the container with id aa3561e8011a04459b25097616dba7b513d6c29afefb9d0014fac7e1a43236d5 Jul 02 14:48:14.517782 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.517751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q8k67" Jul 02 14:48:14.522123 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.522095 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ktp87" Jul 02 14:48:14.525862 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.525837 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3c9901_8765_4e2f_8304_0f82b0990fe6.slice/crio-a414cff41886d7879e85a482ed646f943f8d30e9a4d41ea2cec495c90486e5d1 WatchSource:0}: Error finding container a414cff41886d7879e85a482ed646f943f8d30e9a4d41ea2cec495c90486e5d1: Status 404 returned error can't find the container with id a414cff41886d7879e85a482ed646f943f8d30e9a4d41ea2cec495c90486e5d1 Jul 02 14:48:14.530200 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:14.530177 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd010f319_b874_4149_9bc0_fb9216343efd.slice/crio-173ae8400c618bc7f51b849388667545ad68aaa91cbdb272c5eef02ca39d3144 WatchSource:0}: Error finding container 173ae8400c618bc7f51b849388667545ad68aaa91cbdb272c5eef02ca39d3144: Status 404 returned error can't find the container with id 173ae8400c618bc7f51b849388667545ad68aaa91cbdb272c5eef02ca39d3144 Jul 02 14:48:14.782977 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.782877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:14.782977 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.782934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:14.783144 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.783026 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:14.783144 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.783034 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:14.783144 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.783085 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:48:15.783071237 +0000 UTC m=+3.120127982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:14.783144 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.783099 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret podName:d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:15.783092896 +0000 UTC m=+3.120149641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret") pod "global-pull-secret-syncer-4w8l6" (UID: "d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:14.884263 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:14.884224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:14.884426 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.884400 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:14.884492 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.884431 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:14.884492 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.884442 2559 projected.go:196] Error preparing data for projected volume kube-api-access-th8pw for pod openshift-network-diagnostics/network-check-target-hjjfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:14.884560 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:14.884514 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw podName:f90acceb-2024-451f-aa60-6e113c598de4 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:15.884499504 +0000 UTC m=+3.221556247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-th8pw" (UniqueName: "kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw") pod "network-check-target-hjjfh" (UID: "f90acceb-2024-451f-aa60-6e113c598de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:15.120127 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.119936 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 14:43:14 +0000 UTC" deadline="2027-11-28 08:28:30.952291947 +0000 UTC" Jul 02 14:48:15.120127 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.120012 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12329h40m15.832285271s" Jul 02 14:48:15.155669 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.154241 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:15.155669 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.154412 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:15.178524 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.178388 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" event={"ID":"cc8a477e-5fa0-4332-bf45-bf2c8b42d945","Type":"ContainerStarted","Data":"9f987516a869c4430ac9bfabec29a2d97ce61afefbd5926f9abb17cd4452ce8f"} Jul 02 14:48:15.182871 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.182829 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"28072945457b2433ddee42cf62ac522d294c322cb9dd49cbacfaa82cec2a306a"} Jul 02 14:48:15.196917 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.196874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" event={"ID":"e7eb21fea108827267dcb75a26b4da5c","Type":"ContainerStarted","Data":"18dc71eec9f7ab7991586c8e042aa97277220137e66c3a5ddf444ff5b135f957"} Jul 02 14:48:15.210526 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.210448 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ktp87" event={"ID":"d010f319-b874-4149-9bc0-fb9216343efd","Type":"ContainerStarted","Data":"173ae8400c618bc7f51b849388667545ad68aaa91cbdb272c5eef02ca39d3144"} Jul 02 14:48:15.221810 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.221690 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" event={"ID":"ddcd4d4d-9542-4915-8715-399662ebc436","Type":"ContainerStarted","Data":"aa3561e8011a04459b25097616dba7b513d6c29afefb9d0014fac7e1a43236d5"} Jul 02 14:48:15.234695 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.234663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerStarted","Data":"f53d13c8eb1c97877e6edb64086942dee7bd092857f2cb15c5b7edd9ebe058eb"} Jul 02 14:48:15.254655 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.254552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrg9c" event={"ID":"c426b758-6486-4602-8009-c551664c6a74","Type":"ContainerStarted","Data":"5d92bf99389d6fe985d3d7060efbec5c4fa4b372549f746dd82a70d70a6ca270"} Jul 02 14:48:15.258133 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.258106 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:15.276246 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.276147 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bqp6z" event={"ID":"87346d39-0870-4761-97a0-4624d223b352","Type":"ContainerStarted","Data":"3a5f45d9d3edd9197712bbc53d4d513d6f21695eaec10dd3086c5963183be14d"} Jul 02 14:48:15.285672 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.285574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" event={"ID":"0370d9c46c9da9e1f4e1c6074d7c2819","Type":"ContainerStarted","Data":"8b49d26fa761abc9538cfc400b9f3416282b7053c730fd9c75b4bba413496a74"} Jul 02 14:48:15.296578 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.296423 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q8k67" event={"ID":"ef3c9901-8765-4e2f-8304-0f82b0990fe6","Type":"ContainerStarted","Data":"a414cff41886d7879e85a482ed646f943f8d30e9a4d41ea2cec495c90486e5d1"} Jul 02 14:48:15.315839 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.315799 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-frcsz" event={"ID":"db06ba71-e44a-45f1-b291-7e8f944ce68d","Type":"ContainerStarted","Data":"443d3e48bfe5b75d85e2d4904024a91e80b10f1ae5bbb18bcbfd7c674c447845"} Jul 02 14:48:15.793206 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.792326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:15.793206 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.792392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:15.793206 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.792551 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:15.793206 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.792614 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:48:17.792593622 +0000 UTC m=+5.129650380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:15.793206 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.793063 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:15.793206 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.793123 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret podName:d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:17.793106039 +0000 UTC m=+5.130162802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret") pod "global-pull-secret-syncer-4w8l6" (UID: "d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:15.865802 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.865484 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:15.893176 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:15.893136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:15.893422 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.893369 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:15.893422 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.893396 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:15.893422 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.893411 2559 projected.go:196] Error preparing data for projected volume kube-api-access-th8pw for pod openshift-network-diagnostics/network-check-target-hjjfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:15.893608 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:15.893479 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw podName:f90acceb-2024-451f-aa60-6e113c598de4 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:17.893458483 +0000 UTC m=+5.230515251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-th8pw" (UniqueName: "kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw") pod "network-check-target-hjjfh" (UID: "f90acceb-2024-451f-aa60-6e113c598de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:16.121695 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:16.120604 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 14:43:14 +0000 UTC" deadline="2028-02-14 23:33:59.331915202 +0000 UTC" Jul 02 14:48:16.121695 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:16.120638 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14216h45m43.211280623s" Jul 02 14:48:16.153343 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:16.153307 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:16.153538 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:16.153451 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:16.153946 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:16.153918 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:16.154087 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:16.154034 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:17.154001 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:17.152812 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:17.154001 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.153214 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:17.806769 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:17.806713 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:17.806982 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:17.806814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:17.806982 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.806961 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:17.807107 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.807031 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret podName:d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:21.807009225 +0000 UTC m=+9.144065990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret") pod "global-pull-secret-syncer-4w8l6" (UID: "d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:17.807464 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.807441 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:17.807561 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.807498 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:48:21.807481621 +0000 UTC m=+9.144538384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:17.907456 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:17.907417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:17.907655 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.907609 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:17.907655 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.907631 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:17.907655 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.907647 2559 projected.go:196] Error preparing data for projected volume kube-api-access-th8pw for pod openshift-network-diagnostics/network-check-target-hjjfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:17.907911 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:17.907733 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw podName:f90acceb-2024-451f-aa60-6e113c598de4 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:21.907690104 +0000 UTC m=+9.244746870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-th8pw" (UniqueName: "kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw") pod "network-check-target-hjjfh" (UID: "f90acceb-2024-451f-aa60-6e113c598de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:18.153317 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:18.153198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:18.153505 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:18.153351 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:18.153779 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:18.153757 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:18.153876 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:18.153862 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:19.155483 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:19.155447 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:19.156055 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:19.155594 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:20.153663 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:20.153167 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:20.153663 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:20.153265 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:20.153663 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:20.153318 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:20.153663 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:20.153358 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:21.153094 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:21.152591 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:21.153094 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.152748 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:21.844423 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:21.844382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:21.844586 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:21.844445 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:21.844586 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.844543 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:21.844586 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.844588 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:48:29.844575698 +0000 UTC m=+17.181632440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:21.844911 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.844894 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:21.844990 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.844934 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret podName:d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:29.844924592 +0000 UTC m=+17.181981334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret") pod "global-pull-secret-syncer-4w8l6" (UID: "d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:21.946181 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:21.945526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:21.946181 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.945708 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:21.946181 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.945732 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:21.946181 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.945747 2559 projected.go:196] Error preparing data for projected volume kube-api-access-th8pw for pod openshift-network-diagnostics/network-check-target-hjjfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:21.946181 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:21.945804 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw podName:f90acceb-2024-451f-aa60-6e113c598de4 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:29.945785637 +0000 UTC m=+17.282842381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-th8pw" (UniqueName: "kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw") pod "network-check-target-hjjfh" (UID: "f90acceb-2024-451f-aa60-6e113c598de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:22.153058 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:22.153024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:22.153232 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:22.153024 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:22.153232 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:22.153162 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:22.153232 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:22.153216 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:23.153759 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:23.153729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:23.154367 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:23.154339 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:24.153008 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:24.152973 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:24.153214 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:24.153096 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:24.153469 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:24.153449 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:24.153548 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:24.153531 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:25.153060 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:25.152985 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:25.153490 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:25.153120 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:26.152744 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:26.152711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:26.152937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:26.152711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:26.152937 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:26.152834 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:26.152937 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:26.152912 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:27.153046 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:27.153020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:27.153373 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:27.153136 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:28.152912 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:28.152873 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:28.153076 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:28.152887 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:28.153076 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:28.152981 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:28.153076 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:28.153051 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:29.153044 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:29.153008 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:29.153246 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:29.153154 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:29.902955 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:29.902916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:29.903140 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:29.902969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:29.903140 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:29.903093 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:29.903140 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:29.903091 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:29.903262 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:29.903155 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:48:45.903134178 +0000 UTC m=+33.240190921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:29.903262 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:29.903175 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret podName:d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:45.903165448 +0000 UTC m=+33.240222191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret") pod "global-pull-secret-syncer-4w8l6" (UID: "d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:30.003444 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:30.003412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:30.003596 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:30.003570 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:30.003596 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:30.003594 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:30.003687 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:30.003606 2559 projected.go:196] Error preparing data for projected volume kube-api-access-th8pw for pod openshift-network-diagnostics/network-check-target-hjjfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:30.003687 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:30.003674 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw podName:f90acceb-2024-451f-aa60-6e113c598de4 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:46.003643828 +0000 UTC m=+33.340700584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-th8pw" (UniqueName: "kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw") pod "network-check-target-hjjfh" (UID: "f90acceb-2024-451f-aa60-6e113c598de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:30.152896 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:30.152859 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:30.153085 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:30.152979 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:30.153085 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:30.153032 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:30.153183 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:30.153120 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:31.152918 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:31.152895 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:31.153209 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:31.153024 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:32.153422 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:32.153386 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:32.153422 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:32.153424 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:32.153888 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:32.153501 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:32.153888 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:32.153628 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:33.153196 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:33.153160 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:33.153419 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:33.153251 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:34.152705 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:34.152666 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:34.153152 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:34.152770 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:34.153152 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:34.152830 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:34.153152 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:34.152939 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:35.153083 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:35.153052 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:35.153574 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:35.153186 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:36.152863 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.152836 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:36.153011 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:36.152959 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:36.153011 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.152992 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:36.153086 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:36.153057 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:36.370828 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.370593 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" event={"ID":"ddcd4d4d-9542-4915-8715-399662ebc436","Type":"ContainerStarted","Data":"fbd05d8bc78f2293480fa276fec6fca630cc343e01aef20edae25322408186da"} Jul 02 14:48:36.372142 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.372089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" event={"ID":"0370d9c46c9da9e1f4e1c6074d7c2819","Type":"ContainerStarted","Data":"2ea584fb210080e17e8f90353d93e345e2afc2aaad2011f41b8d5a2fc7cb185b"} Jul 02 14:48:36.373671 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.373619 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q8k67" event={"ID":"ef3c9901-8765-4e2f-8304-0f82b0990fe6","Type":"ContainerStarted","Data":"01bab3ddb8ef5bcf51963441e8c239f28ea4c22502b1167cf9d3b2089d554fea"} Jul 02 14:48:36.378320 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.378286 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"01d5920e58bc673a0a47b851cdfb73d73ceb9057c46b61f959b2d3d4bdd94517"} Jul 02 14:48:36.390962 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.390912 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9ddsk" podStartSLOduration=2.202807694 podStartE2EDuration="23.390874814s" totalImagesPullingTime="21.18806712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:36.390843594 +0000 UTC m=+23.727900358" watchObservedRunningTime="2026-07-02 14:48:36.390874814 +0000 UTC m=+23.727931567" Jul 02 14:48:36.404777 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.404739 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-44.ec2.internal" podStartSLOduration=22.404725963 podStartE2EDuration="22.404725963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:36.404547158 +0000 UTC m=+23.741603923" watchObservedRunningTime="2026-07-02 14:48:36.404725963 +0000 UTC m=+23.741782727" Jul 02 14:48:36.437016 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:36.435973 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q8k67" podStartSLOduration=2.245726016 podStartE2EDuration="23.43583189s" totalImagesPullingTime="21.190105874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:36.435294648 +0000 UTC m=+23.772351436" watchObservedRunningTime="2026-07-02 14:48:36.43583189 +0000 UTC m=+23.772891133" Jul 02 14:48:37.153018 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.152985 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:37.153176 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:37.153122 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:37.382366 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.382099 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-frcsz" event={"ID":"db06ba71-e44a-45f1-b291-7e8f944ce68d","Type":"ContainerStarted","Data":"d312d3947aad8c0489721e5ffdcebea53699794e2676f6f5aa5349e9d92ed4ac"} Jul 02 14:48:37.383825 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.383802 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" event={"ID":"cc8a477e-5fa0-4332-bf45-bf2c8b42d945","Type":"ContainerStarted","Data":"44d5612402accff46c7a0e7afb5b5bd99cfe18af7c4620afc39c151c6bbaa4f4"} Jul 02 14:48:37.386719 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.386689 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 14:48:37.387060 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.387040 2559 generic.go:356] "Generic (PLEG): container finished" podID="b3b0ee35-fe39-449c-964f-bd291f1fbaf4" containerID="10d0a02d65cfcab5251a53e993c5f118d39fb7b1757334ac9e63c6d013fba9a6" exitCode=1 Jul 02 14:48:37.387159 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.387097 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"a8784028b0f7fec9870f6137409204be47bf027fa9b12b91ef420348386b81cb"} Jul 02 14:48:37.387219 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.387175 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"204f4f7dbd100d550d3e2b7dc53d6d4f40fa3e636e83bd458f2f88478fd5cbab"} Jul 02 14:48:37.387271 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.387226 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"f7959dfe3cef179b5e261524d1c6ce0adda1f67b0cacefb1d8480c2b53fadd6c"} Jul 02 14:48:37.387320 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.387275 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"637f9e9675c45afd22ae6eb9acb175e321ca7e36604bd477c7ea510e694857d1"} Jul 02 14:48:37.387372 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.387324 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerDied","Data":"10d0a02d65cfcab5251a53e993c5f118d39fb7b1757334ac9e63c6d013fba9a6"} Jul 02 14:48:37.388743 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.388719 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7eb21fea108827267dcb75a26b4da5c" containerID="b7d30a29c9a32251e897eefc17daa7fdd5e0e23b0f59b8e9a1d0fbf3c73e2a48" exitCode=0 Jul 02 14:48:37.388879 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.388808 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" event={"ID":"e7eb21fea108827267dcb75a26b4da5c","Type":"ContainerDied","Data":"b7d30a29c9a32251e897eefc17daa7fdd5e0e23b0f59b8e9a1d0fbf3c73e2a48"} Jul 02 14:48:37.390346 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.390316 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ktp87" event={"ID":"d010f319-b874-4149-9bc0-fb9216343efd","Type":"ContainerStarted","Data":"287c7d734d5e3d7755478b4c294c7aa469a668e5537bcf2c5547b7257b322007"} Jul 02 14:48:37.391860 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.391837 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerStarted","Data":"3dcfc01876766c2e25d7630c5c7709239d1c525486c1ba6ccd2c2045b4e210c4"} Jul 02 14:48:37.393232 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.393141 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wrg9c" event={"ID":"c426b758-6486-4602-8009-c551664c6a74","Type":"ContainerStarted","Data":"ec4b2e6634dc7bae216f3959351b1d358e40d3820c7920049fcb4b07a911130a"} Jul 02 14:48:37.394586 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.394562 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bqp6z" event={"ID":"87346d39-0870-4761-97a0-4624d223b352","Type":"ContainerStarted","Data":"0e5c00f03e4f2e8e96d39ed50f0c370e77da6ca8dd3706c41a602f5f03675ac4"} Jul 02 14:48:37.400235 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.400200 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-frcsz" podStartSLOduration=3.180493661 podStartE2EDuration="24.400188347s" totalImagesPullingTime="21.219694686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:37.399753176 +0000 UTC m=+24.736809939" watchObservedRunningTime="2026-07-02 14:48:37.400188347 +0000 UTC m=+24.737245110" Jul 02 14:48:37.411775 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.411750 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:37.412274 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.412257 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:37.415275 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.415242 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wrg9c" podStartSLOduration=3.209803272 podStartE2EDuration="24.41523021s" totalImagesPullingTime="21.205426938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:37.415207409 +0000 UTC m=+24.752264173" watchObservedRunningTime="2026-07-02 14:48:37.41523021 +0000 UTC m=+24.752286952" Jul 02 14:48:37.430297 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.430261 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bqp6z" podStartSLOduration=3.180630965 podStartE2EDuration="24.430247117s" totalImagesPullingTime="21.249616152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:37.430234529 +0000 UTC m=+24.767291293" watchObservedRunningTime="2026-07-02 14:48:37.430247117 +0000 UTC m=+24.767303882" Jul 02 14:48:37.477230 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:37.477181 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ktp87" podStartSLOduration=3.322360392 podStartE2EDuration="24.477165353s" totalImagesPullingTime="21.154804961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:37.477035137 +0000 UTC m=+24.814091901" watchObservedRunningTime="2026-07-02 14:48:37.477165353 +0000 UTC m=+24.814222117" Jul 02 14:48:38.153446 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:38.153418 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:38.153772 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:38.153528 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:38.153772 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:38.153585 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:38.153772 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:38.153702 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:38.398621 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:38.398590 2559 generic.go:356] "Generic (PLEG): container finished" podID="6bd50344-c877-4066-8fe6-9e38645f3839" containerID="3dcfc01876766c2e25d7630c5c7709239d1c525486c1ba6ccd2c2045b4e210c4" exitCode=0 Jul 02 14:48:38.399061 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:38.398677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerDied","Data":"3dcfc01876766c2e25d7630c5c7709239d1c525486c1ba6ccd2c2045b4e210c4"} Jul 02 14:48:38.400295 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:38.400273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" event={"ID":"e7eb21fea108827267dcb75a26b4da5c","Type":"ContainerStarted","Data":"90411e965edb4803a9affd750ad05c1085bee8f6c31a15aed96d7942d8192a56"} Jul 02 14:48:38.418325 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:38.418240 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-44.ec2.internal" podStartSLOduration=24.418226028 podStartE2EDuration="24.418226028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:38.417927722 +0000 UTC m=+25.754984488" watchObservedRunningTime="2026-07-02 14:48:38.418226028 +0000 UTC m=+25.755282795" Jul 02 14:48:38.913330 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:38.913301 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 14:48:39.154018 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:39.153534 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:39.154018 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:39.153481 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T14:48:38.913323788Z","UUID":"3ca6d5b1-d988-40ca-b95f-948260e7ab99","Handler":null,"Name":"","Endpoint":""} Jul 02 14:48:39.154018 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:39.153693 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:39.154864 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:39.154843 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 14:48:39.154962 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:39.154888 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 14:48:39.404936 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:39.404847 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" event={"ID":"cc8a477e-5fa0-4332-bf45-bf2c8b42d945","Type":"ContainerStarted","Data":"a8f14c09d75ef2f58df7f2679677af427738f0d8d13b83cca3f1aa610c4847b7"} Jul 02 14:48:39.408180 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:39.408154 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 14:48:39.408583 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:39.408561 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"860e0835132ff67c37960622d72289487055634c240c65cf30f5718261384de4"} Jul 02 14:48:39.408583 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:39.408579 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 14:48:40.153529 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:40.153298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:40.153906 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:40.153302 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:40.153906 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:40.153671 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:40.153906 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:40.153753 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:41.152891 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:41.152857 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:41.153361 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:41.152981 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:41.415504 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:41.415419 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" event={"ID":"cc8a477e-5fa0-4332-bf45-bf2c8b42d945","Type":"ContainerStarted","Data":"9d680a1722cc3bb2065e57eb3a9ca701c5cf3c8581df0d70cc758589de50b8c6"} Jul 02 14:48:41.434851 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:41.434793 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwxlb" podStartSLOduration=4.26847064 podStartE2EDuration="28.434775151s" totalImagesPullingTime="24.166304511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:41.433483987 +0000 UTC m=+28.770540772" watchObservedRunningTime="2026-07-02 14:48:41.434775151 +0000 UTC m=+28.771831916" Jul 02 14:48:42.152744 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:42.152705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:42.152929 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:42.152705 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:42.152929 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:42.152826 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:42.152929 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:42.152911 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:42.223810 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:42.223777 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:42.223986 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:42.223903 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 14:48:42.224384 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:42.224353 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bqp6z" Jul 02 14:48:43.154403 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:43.154151 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:43.155041 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:43.154523 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:43.422981 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:43.422894 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 14:48:43.423325 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:43.423303 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"51efa66cb9408b742924f3f686cee6a9720a79db69c6444873781a32750be4c0"} Jul 02 14:48:43.423603 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:43.423547 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:43.423778 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:43.423733 2559 scope.go:117] "RemoveContainer" containerID="10d0a02d65cfcab5251a53e993c5f118d39fb7b1757334ac9e63c6d013fba9a6" Jul 02 14:48:43.425343 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:43.425318 2559 generic.go:356] "Generic (PLEG): container finished" podID="6bd50344-c877-4066-8fe6-9e38645f3839" containerID="fa2a42496ea8ac3200e81970c3693622780a21b76f03d06486532f7e0f9c391c" exitCode=0 Jul 02 14:48:43.425433 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:43.425363 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerDied","Data":"fa2a42496ea8ac3200e81970c3693622780a21b76f03d06486532f7e0f9c391c"} Jul 02 14:48:43.441188 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:43.441157 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:44.153362 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.153321 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:44.153662 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.153336 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:44.153662 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:44.153487 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:44.153662 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:44.153584 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:44.432026 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.431999 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 14:48:44.432394 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.432367 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" event={"ID":"b3b0ee35-fe39-449c-964f-bd291f1fbaf4","Type":"ContainerStarted","Data":"e143f5922ca6e80fcd799a38b1e7b16400a3c0d6006a49cf2a5f10bd85746250"} Jul 02 14:48:44.432767 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.432750 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:44.432863 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.432820 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:44.449307 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.449284 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:48:44.461980 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.461927 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" podStartSLOduration=9.851387515999999 podStartE2EDuration="31.461906773s" totalImagesPullingTime="21.610519257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:44.459881223 +0000 UTC m=+31.796938002" watchObservedRunningTime="2026-07-02 14:48:44.461906773 +0000 UTC m=+31.798963539" Jul 02 14:48:44.908494 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.908415 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hjjfh"] Jul 02 14:48:44.908632 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.908547 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:44.908632 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:44.908620 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:44.911550 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.911519 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n6vnp"] Jul 02 14:48:44.911686 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.911616 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:44.911737 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:44.911714 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:44.922551 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.922523 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4w8l6"] Jul 02 14:48:44.922697 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:44.922645 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:44.922785 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:44.922761 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:45.436271 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:45.436172 2559 generic.go:356] "Generic (PLEG): container finished" podID="6bd50344-c877-4066-8fe6-9e38645f3839" containerID="609cc36b475ed74348f9bd72648322770d82fbe8f1703124e3e0ca95d5556cf8" exitCode=0 Jul 02 14:48:45.436271 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:45.436254 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerDied","Data":"609cc36b475ed74348f9bd72648322770d82fbe8f1703124e3e0ca95d5556cf8"} Jul 02 14:48:45.917409 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:45.917229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:45.917543 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:45.917435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:45.917543 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:45.917372 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:45.917543 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:45.917533 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:45.917676 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:45.917534 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret podName:d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd nodeName:}" failed. No retries permitted until 2026-07-02 14:49:17.917519266 +0000 UTC m=+65.254576008 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret") pod "global-pull-secret-syncer-4w8l6" (UID: "d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:45.917676 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:45.917582 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:49:17.917570143 +0000 UTC m=+65.254626884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:46.018686 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:46.018632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:46.018854 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:46.018786 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:46.018854 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:46.018800 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:46.018854 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:46.018811 2559 projected.go:196] Error preparing data for projected volume kube-api-access-th8pw for pod openshift-network-diagnostics/network-check-target-hjjfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:46.018980 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:46.018861 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw podName:f90acceb-2024-451f-aa60-6e113c598de4 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:18.018847876 +0000 UTC m=+65.355904618 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-th8pw" (UniqueName: "kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw") pod "network-check-target-hjjfh" (UID: "f90acceb-2024-451f-aa60-6e113c598de4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:47.152825 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:47.152726 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:47.152825 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:47.152755 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:47.152825 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:47.152800 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:47.153553 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:47.153220 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:47.153553 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:47.153423 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:47.153681 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:47.153547 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:47.442404 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:47.442324 2559 generic.go:356] "Generic (PLEG): container finished" podID="6bd50344-c877-4066-8fe6-9e38645f3839" containerID="871b01adb2cf6a812e7cd048245b4d17677752149588b1091dfa8d5b651bf189" exitCode=0 Jul 02 14:48:47.442404 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:47.442380 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerDied","Data":"871b01adb2cf6a812e7cd048245b4d17677752149588b1091dfa8d5b651bf189"} Jul 02 14:48:49.153620 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.152886 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:49.153620 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.152906 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:49.153620 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:49.153018 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hjjfh" podUID="f90acceb-2024-451f-aa60-6e113c598de4" Jul 02 14:48:49.153620 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.153197 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:49.153620 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:49.153281 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4w8l6" podUID="d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd" Jul 02 14:48:49.153620 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:49.153484 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:48:49.928023 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.927996 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-44.ec2.internal" event="NodeReady" Jul 02 14:48:49.928179 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.928137 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 14:48:49.968861 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.968831 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68886f9b4-c22t2"] Jul 02 14:48:49.973131 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.973112 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:49.977178 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.977159 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 14:48:49.977487 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.977472 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 14:48:49.978169 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.978019 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj2f4\"" Jul 02 14:48:49.979134 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.979119 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 14:48:49.988850 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.988830 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 14:48:49.989156 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.989136 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5"] Jul 02 14:48:49.992851 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.992831 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq"] Jul 02 14:48:49.992969 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.992952 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:49.996465 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.996444 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf"] Jul 02 14:48:49.996545 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.996509 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 14:48:49.996545 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.996536 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:49.996759 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.996739 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 14:48:49.996846 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.996745 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 14:48:49.997118 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.997101 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 14:48:49.999426 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.999409 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 14:48:49.999529 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.999514 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 14:48:49.999801 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.999785 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p4nnm\"" Jul 02 14:48:50.000005 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:49.999991 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tb4tg"] Jul 02 14:48:50.000128 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.000097 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.002845 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.002829 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 14:48:50.003317 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.003297 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 14:48:50.003425 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.003367 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kvp9z"] Jul 02 14:48:50.003508 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.003484 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 14:48:50.003563 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.003520 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 14:48:50.003786 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.003769 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.006878 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.006861 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9"] Jul 02 14:48:50.006993 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.006977 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kvp9z" Jul 02 14:48:50.009479 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.009458 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 14:48:50.009775 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.009757 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gj4nd\"" Jul 02 14:48:50.009991 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.009975 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 14:48:50.012399 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.012373 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68886f9b4-c22t2"] Jul 02 14:48:50.012474 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.012420 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 14:48:50.012474 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.012429 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5"] Jul 02 14:48:50.012474 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.012451 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq"] Jul 02 14:48:50.012474 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.012470 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kvp9z"] Jul 02 14:48:50.012599 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.012591 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:48:50.012693 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.012678 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpgfg\"" Jul 02 14:48:50.012910 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.012893 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 14:48:50.013141 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.013122 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9"] Jul 02 14:48:50.013236 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.013151 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 14:48:50.016407 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.016389 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 02 14:48:50.016542 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.016525 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-q7djm\"" Jul 02 14:48:50.017725 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.017696 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tb4tg"] Jul 02 14:48:50.018477 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.018455 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf"] Jul 02 14:48:50.049150 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.049130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.049264 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.049164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-ca-trust-extracted\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.049264 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.049189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9pww\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-kube-api-access-k9pww\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.049375 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.049268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-trusted-ca\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.049375 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.049312 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-certificates\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.049375 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.049343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-installation-pull-secrets\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.049523 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.049405 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-image-registry-private-configuration\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.049523 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.049438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-bound-sa-token\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.149890 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.149845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.150090 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.149903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9pww\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-kube-api-access-k9pww\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150090 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.149997 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnn5d\" (UniqueName: \"kubernetes.io/projected/e707e3de-1d9e-4adf-998b-64e3cc8cf201-kube-api-access-gnn5d\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.150090 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e707e3de-1d9e-4adf-998b-64e3cc8cf201-tmp-dir\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.150237 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/afccebd4-0aee-4f9c-b6a6-dee44a335087-klusterlet-config\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.150237 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-certificates\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150322 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:50.150322 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150294 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-installation-pull-secrets\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150393 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afccebd4-0aee-4f9c-b6a6-dee44a335087-tmp\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.150393 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-image-registry-private-configuration\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150393 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-ca\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.150502 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e707e3de-1d9e-4adf-998b-64e3cc8cf201-config-volume\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.150502 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.150502 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150489 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150604 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-ca-trust-extracted\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150604 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150545 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:50.150604 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2cv\" (UniqueName: \"kubernetes.io/projected/a4afca32-45f3-4cc2-9077-8252d5afc34f-kube-api-access-bw2cv\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.150604 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67f7n\" (UniqueName: \"kubernetes.io/projected/afccebd4-0aee-4f9c-b6a6-dee44a335087-kube-api-access-67f7n\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.150773 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e920e3e-fe66-4a55-a5ed-c0714de82f53-cert\") pod \"ingress-canary-kvp9z\" (UID: \"1e920e3e-fe66-4a55-a5ed-c0714de82f53\") " pod="openshift-ingress-canary/ingress-canary-kvp9z" Jul 02 14:48:50.150773 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-hub\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.150773 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8zqs\" (UniqueName: \"kubernetes.io/projected/0648468f-9f7a-4421-8711-b22fd23b5213-kube-api-access-d8zqs\") pod \"managed-serviceaccount-addon-agent-74df6c567d-rpbh9\" (UID: \"0648468f-9f7a-4421-8711-b22fd23b5213\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:48:50.150773 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-trusted-ca\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150773 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.150773 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4afca32-45f3-4cc2-9077-8252d5afc34f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.150970 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-certificates\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150970 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150796 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-bound-sa-token\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.150970 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wftq\" (UniqueName: \"kubernetes.io/projected/1e920e3e-fe66-4a55-a5ed-c0714de82f53-kube-api-access-8wftq\") pod \"ingress-canary-kvp9z\" (UID: \"1e920e3e-fe66-4a55-a5ed-c0714de82f53\") " pod="openshift-ingress-canary/ingress-canary-kvp9z" Jul 02 14:48:50.150970 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.150876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0648468f-9f7a-4421-8711-b22fd23b5213-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74df6c567d-rpbh9\" (UID: \"0648468f-9f7a-4421-8711-b22fd23b5213\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:48:50.151256 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.151239 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:50.151325 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.151260 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:48:50.151325 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.151315 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:50.651297057 +0000 UTC m=+37.988353803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:48:50.151767 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.151672 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-ca-trust-extracted\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.152433 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.152407 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-trusted-ca\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.155035 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.155010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-installation-pull-secrets\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.155389 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.155039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-image-registry-private-configuration\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.159704 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.159605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9pww\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-kube-api-access-k9pww\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.160683 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.160410 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-bound-sa-token\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.252155 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/afccebd4-0aee-4f9c-b6a6-dee44a335087-klusterlet-config\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.252155 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252162 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:50.252417 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afccebd4-0aee-4f9c-b6a6-dee44a335087-tmp\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.252417 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-ca\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.252417 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252285 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e707e3de-1d9e-4adf-998b-64e3cc8cf201-config-volume\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.252417 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.252417 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:50.252417 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2cv\" (UniqueName: \"kubernetes.io/projected/a4afca32-45f3-4cc2-9077-8252d5afc34f-kube-api-access-bw2cv\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252445 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67f7n\" (UniqueName: \"kubernetes.io/projected/afccebd4-0aee-4f9c-b6a6-dee44a335087-kube-api-access-67f7n\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e920e3e-fe66-4a55-a5ed-c0714de82f53-cert\") pod \"ingress-canary-kvp9z\" (UID: \"1e920e3e-fe66-4a55-a5ed-c0714de82f53\") " pod="openshift-ingress-canary/ingress-canary-kvp9z" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-hub\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252525 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8zqs\" (UniqueName: \"kubernetes.io/projected/0648468f-9f7a-4421-8711-b22fd23b5213-kube-api-access-d8zqs\") pod \"managed-serviceaccount-addon-agent-74df6c567d-rpbh9\" (UID: \"0648468f-9f7a-4421-8711-b22fd23b5213\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252585 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4afca32-45f3-4cc2-9077-8252d5afc34f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252612 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afccebd4-0aee-4f9c-b6a6-dee44a335087-tmp\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252626 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wftq\" (UniqueName: \"kubernetes.io/projected/1e920e3e-fe66-4a55-a5ed-c0714de82f53-kube-api-access-8wftq\") pod \"ingress-canary-kvp9z\" (UID: \"1e920e3e-fe66-4a55-a5ed-c0714de82f53\") " pod="openshift-ingress-canary/ingress-canary-kvp9z" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252716 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0648468f-9f7a-4421-8711-b22fd23b5213-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74df6c567d-rpbh9\" (UID: \"0648468f-9f7a-4421-8711-b22fd23b5213\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:48:50.252751 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.253280 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnn5d\" (UniqueName: \"kubernetes.io/projected/e707e3de-1d9e-4adf-998b-64e3cc8cf201-kube-api-access-gnn5d\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.253280 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e707e3de-1d9e-4adf-998b-64e3cc8cf201-tmp-dir\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.253280 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.252816 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:50.253280 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.252955 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:50.752935228 +0000 UTC m=+38.089991971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:48:50.253280 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.252969 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:50.253280 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.253016 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:48:50.253280 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.253066 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:50.753054043 +0000 UTC m=+38.090110785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:48:50.253637 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.253365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e707e3de-1d9e-4adf-998b-64e3cc8cf201-config-volume\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.254441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.254013 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e707e3de-1d9e-4adf-998b-64e3cc8cf201-tmp-dir\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.254881 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.254851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4afca32-45f3-4cc2-9077-8252d5afc34f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.255823 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.255794 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/afccebd4-0aee-4f9c-b6a6-dee44a335087-klusterlet-config\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.256412 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.256387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-ca\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.257832 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.257809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.257832 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.257821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.258009 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.257854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e920e3e-fe66-4a55-a5ed-c0714de82f53-cert\") pod \"ingress-canary-kvp9z\" (UID: \"1e920e3e-fe66-4a55-a5ed-c0714de82f53\") " pod="openshift-ingress-canary/ingress-canary-kvp9z" Jul 02 14:48:50.258130 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.258109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0648468f-9f7a-4421-8711-b22fd23b5213-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74df6c567d-rpbh9\" (UID: \"0648468f-9f7a-4421-8711-b22fd23b5213\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:48:50.258267 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.258249 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a4afca32-45f3-4cc2-9077-8252d5afc34f-hub\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.265542 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.265492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2cv\" (UniqueName: \"kubernetes.io/projected/a4afca32-45f3-4cc2-9077-8252d5afc34f-kube-api-access-bw2cv\") pod \"cluster-proxy-proxy-agent-8498cc7cd9-9xpmf\" (UID: \"a4afca32-45f3-4cc2-9077-8252d5afc34f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.266210 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.266182 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67f7n\" (UniqueName: \"kubernetes.io/projected/afccebd4-0aee-4f9c-b6a6-dee44a335087-kube-api-access-67f7n\") pod \"klusterlet-addon-workmgr-7598864cf6-bnnl5\" (UID: \"afccebd4-0aee-4f9c-b6a6-dee44a335087\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.266210 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.266187 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wftq\" (UniqueName: \"kubernetes.io/projected/1e920e3e-fe66-4a55-a5ed-c0714de82f53-kube-api-access-8wftq\") pod \"ingress-canary-kvp9z\" (UID: \"1e920e3e-fe66-4a55-a5ed-c0714de82f53\") " pod="openshift-ingress-canary/ingress-canary-kvp9z" Jul 02 14:48:50.266448 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.266429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnn5d\" (UniqueName: \"kubernetes.io/projected/e707e3de-1d9e-4adf-998b-64e3cc8cf201-kube-api-access-gnn5d\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.268571 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.268527 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8zqs\" (UniqueName: \"kubernetes.io/projected/0648468f-9f7a-4421-8711-b22fd23b5213-kube-api-access-d8zqs\") pod \"managed-serviceaccount-addon-agent-74df6c567d-rpbh9\" (UID: \"0648468f-9f7a-4421-8711-b22fd23b5213\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:48:50.305214 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.305134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:48:50.336323 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.336288 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:48:50.349580 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.349557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kvp9z" Jul 02 14:48:50.355744 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.355718 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:48:50.444696 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.444458 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5"] Jul 02 14:48:50.655955 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.655830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:50.656101 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.655967 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:50.656101 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.655985 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:48:50.656101 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.656057 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:51.656034089 +0000 UTC m=+38.993090831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:48:50.757048 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.757014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:50.757231 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.757081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:50.757231 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.757167 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:50.757231 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.757181 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:48:50.757231 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.757233 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:51.757215332 +0000 UTC m=+39.094272097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:48:50.757456 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:50.757248 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:51.757241341 +0000 UTC m=+39.094298083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:48:50.889483 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.889440 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:50.976571 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:50.976492 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:51.153266 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.153230 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:48:51.153451 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.153240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:48:51.153451 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.153243 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:48:51.157233 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.157209 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:48:51.157233 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.157220 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:48:51.158901 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.158886 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:48:51.158979 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.158888 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:48:51.159040 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.159027 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rrv2x\"" Jul 02 14:48:51.159142 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.159130 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wp67j\"" Jul 02 14:48:51.664729 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.664683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:51.664881 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:51.664826 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:51.664881 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:51.664837 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:48:51.664965 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:51.664888 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:53.664875884 +0000 UTC m=+41.001932626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:48:51.765496 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.765455 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:51.765706 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:51.765526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:51.765706 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:51.765668 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:51.765706 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:51.765693 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:48:51.765876 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:51.765744 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:53.765725006 +0000 UTC m=+41.102781757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:48:51.765876 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:51.765765 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:53.765754704 +0000 UTC m=+41.102811450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:48:51.845210 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:51.845167 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafccebd4_0aee_4f9c_b6a6_dee44a335087.slice/crio-4feb6c9c2eb33000ba8b7b318b58d7334413c761b7baa46d51b0729edeb2a569 WatchSource:0}: Error finding container 4feb6c9c2eb33000ba8b7b318b58d7334413c761b7baa46d51b0729edeb2a569: Status 404 returned error can't find the container with id 4feb6c9c2eb33000ba8b7b318b58d7334413c761b7baa46d51b0729edeb2a569 Jul 02 14:48:52.044983 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.044958 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kvp9z"] Jul 02 14:48:52.048725 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.048705 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf"] Jul 02 14:48:52.052393 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.052372 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9"] Jul 02 14:48:52.055893 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:48:52.055869 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0648468f_9f7a_4421_8711_b22fd23b5213.slice/crio-171e23d4ae20816eec7cde889ce258f587407af551d2b5b3baa5428f0081f35b WatchSource:0}: Error finding container 171e23d4ae20816eec7cde889ce258f587407af551d2b5b3baa5428f0081f35b: Status 404 returned error can't find the container with id 171e23d4ae20816eec7cde889ce258f587407af551d2b5b3baa5428f0081f35b Jul 02 14:48:52.455378 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.455287 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" event={"ID":"0648468f-9f7a-4421-8711-b22fd23b5213","Type":"ContainerStarted","Data":"171e23d4ae20816eec7cde889ce258f587407af551d2b5b3baa5428f0081f35b"} Jul 02 14:48:52.456462 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.456432 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" event={"ID":"afccebd4-0aee-4f9c-b6a6-dee44a335087","Type":"ContainerStarted","Data":"4feb6c9c2eb33000ba8b7b318b58d7334413c761b7baa46d51b0729edeb2a569"} Jul 02 14:48:52.458961 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.458940 2559 generic.go:356] "Generic (PLEG): container finished" podID="6bd50344-c877-4066-8fe6-9e38645f3839" containerID="cd32114f50aab4422dd273cacdf0cfdbc62ba6f1cf64d40b7de00291dc33c89b" exitCode=0 Jul 02 14:48:52.459036 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.459006 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerDied","Data":"cd32114f50aab4422dd273cacdf0cfdbc62ba6f1cf64d40b7de00291dc33c89b"} Jul 02 14:48:52.460059 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.460034 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kvp9z" event={"ID":"1e920e3e-fe66-4a55-a5ed-c0714de82f53","Type":"ContainerStarted","Data":"ca1f4f057dfb5715d62b075b65d6e28ff45785685895fa80e28f44e320d320b7"} Jul 02 14:48:52.461007 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:52.460988 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" event={"ID":"a4afca32-45f3-4cc2-9077-8252d5afc34f","Type":"ContainerStarted","Data":"7043307b677360a77aa1839ea7563d4e9fd35e9a855f42f544c747d02fb7dc9d"} Jul 02 14:48:53.470706 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:53.470271 2559 generic.go:356] "Generic (PLEG): container finished" podID="6bd50344-c877-4066-8fe6-9e38645f3839" containerID="05c5575fb5a794d69520a4bb03295a284c002674a195fa21e1212c78ca77cb96" exitCode=0 Jul 02 14:48:53.470706 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:53.470419 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerDied","Data":"05c5575fb5a794d69520a4bb03295a284c002674a195fa21e1212c78ca77cb96"} Jul 02 14:48:53.595336 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:53.595297 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:53.684223 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:53.684191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:53.684439 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:53.684417 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:53.684439 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:53.684437 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:48:53.684616 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:53.684480 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:57.684467373 +0000 UTC m=+45.021524128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:48:53.688091 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:53.687982 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:53.786473 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:53.785520 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:53.786473 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:53.785677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:53.786473 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:53.785832 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:53.786473 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:53.785894 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:57.785873824 +0000 UTC m=+45.122930575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:48:53.786473 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:53.786309 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:48:53.786473 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:53.786360 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:57.786343943 +0000 UTC m=+45.123400698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:48:54.495277 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:54.494686 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" event={"ID":"6bd50344-c877-4066-8fe6-9e38645f3839","Type":"ContainerStarted","Data":"75c9779ced7ff2bdcfcc60b6ac0934b53b5a9c70c173031ba2035ada0bf57d75"} Jul 02 14:48:54.524403 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:54.524060 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kg7lv" podStartSLOduration=8.02356969 podStartE2EDuration="41.524039185s" totalImagesPullingTime="33.500469495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:54.521514202 +0000 UTC m=+41.858570968" watchObservedRunningTime="2026-07-02 14:48:54.524039185 +0000 UTC m=+41.861095953" Jul 02 14:48:54.694275 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:54.694223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:54.786410 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:54.786302 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:54.840592 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:54.840500 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:56.613577 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:56.613545 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:56.682124 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:56.682088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:57.469847 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:57.469816 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:57.568085 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:57.568047 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:57.719944 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:57.719863 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:48:57.720286 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:57.720025 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:57.720286 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:57.720042 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:48:57.720286 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:57.720096 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:05.720080317 +0000 UTC m=+53.057137076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:48:57.820340 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:57.820306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:48:57.820512 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:57.820398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:48:57.820512 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:57.820480 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:48:57.820512 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:57.820497 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:57.820671 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:57.820557 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:05.820535802 +0000 UTC m=+53.157592547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:48:57.820671 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:48:57.820585 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:05.820575685 +0000 UTC m=+53.157632434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:48:59.002908 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:59.002870 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:48:59.078217 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:48:59.078159 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:00.513508 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.513472 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" event={"ID":"afccebd4-0aee-4f9c-b6a6-dee44a335087","Type":"ContainerStarted","Data":"f69c78da48e2a2e1eff30b6dc9de30905100e87ee5609c14149d936ce5069e76"} Jul 02 14:49:00.513942 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.513674 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:49:00.515141 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.515116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kvp9z" event={"ID":"1e920e3e-fe66-4a55-a5ed-c0714de82f53","Type":"ContainerStarted","Data":"ee072e9f12e1e649db8eaf92fb7a0b7a0d7b056b04f123dd89e0eca444f924c0"} Jul 02 14:49:00.515513 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.515492 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:49:00.516865 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.516836 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" event={"ID":"a4afca32-45f3-4cc2-9077-8252d5afc34f","Type":"ContainerStarted","Data":"155c16298fafa21f9dee7d4989e2e2b237e8d1af6073fe8a165a0abbf6395cef"} Jul 02 14:49:00.517035 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.516869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" event={"ID":"a4afca32-45f3-4cc2-9077-8252d5afc34f","Type":"ContainerStarted","Data":"447896c1e6460822152bb896f1f7778812aa81fe4d43be78dd86291d556fe2b3"} Jul 02 14:49:00.518235 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.518214 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" event={"ID":"0648468f-9f7a-4421-8711-b22fd23b5213","Type":"ContainerStarted","Data":"e7bdd6a37d5bf596f15e1d02a3718ed80d915b33e5b98519fc75f53261139ca5"} Jul 02 14:49:00.532458 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.532419 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" podStartSLOduration=8.201440367 podStartE2EDuration="16.532407841s" totalImagesPullingTime="8.330967474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:00.531527649 +0000 UTC m=+47.868584413" watchObservedRunningTime="2026-07-02 14:49:00.532407841 +0000 UTC m=+47.869464582" Jul 02 14:49:00.547496 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.547458 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kvp9z" podStartSLOduration=3.419320928 podStartE2EDuration="11.547444672s" totalImagesPullingTime="8.128123744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:00.547144665 +0000 UTC m=+47.884201447" watchObservedRunningTime="2026-07-02 14:49:00.547444672 +0000 UTC m=+47.884501414" Jul 02 14:49:00.563776 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:00.563734 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" podStartSLOduration=8.444491311 podStartE2EDuration="16.563720034s" totalImagesPullingTime="8.119228723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:00.562905589 +0000 UTC m=+47.899962354" watchObservedRunningTime="2026-07-02 14:49:00.563720034 +0000 UTC m=+47.900776797" Jul 02 14:49:01.526441 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:01.526400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" event={"ID":"a4afca32-45f3-4cc2-9077-8252d5afc34f","Type":"ContainerStarted","Data":"b6140478c339a388e7a4d0b9aafa06ea6eefddc40e5188291d17d8785e0376d0"} Jul 02 14:49:01.547723 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:01.547677 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" podStartSLOduration=9.407617719 podStartE2EDuration="17.547644249s" totalImagesPullingTime="8.14002653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:01.547159551 +0000 UTC m=+48.884216315" watchObservedRunningTime="2026-07-02 14:49:01.547644249 +0000 UTC m=+48.884701013" Jul 02 14:49:04.946061 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:04.946021 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:05.012479 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:05.012422 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:05.475372 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:05.475330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:05.576461 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:05.576428 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:05.791391 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:05.788735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:49:05.791391 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:05.789024 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:49:05.791391 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:05.789041 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:49:05.791391 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:05.789111 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:21.789092033 +0000 UTC m=+69.126148788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:49:05.889930 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:05.889887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:49:05.890118 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:05.889956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:49:05.890118 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:05.890038 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:05.890118 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:05.890110 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:49:05.890256 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:05.890112 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:21.890096648 +0000 UTC m=+69.227153390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:49:05.890256 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:05.890185 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:21.890167111 +0000 UTC m=+69.227223859 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:49:16.452810 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:16.452784 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jmbqz" Jul 02 14:49:16.619163 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:16.619123 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:16.720531 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:16.720503 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:17.533303 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:17.533266 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:17.631718 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:17.631683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:17.978020 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:17.977986 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:49:17.978208 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:17.978058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:49:17.981397 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:17.981379 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:49:17.981550 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:17.981537 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:49:17.988468 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:17.988448 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:49:17.988523 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:17.988513 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:50:21.988496487 +0000 UTC m=+129.325553229 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : secret "metrics-daemon-secret" not found Jul 02 14:49:17.992223 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:17.992196 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd-original-pull-secret\") pod \"global-pull-secret-syncer-4w8l6\" (UID: \"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd\") " pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:49:18.078928 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.078900 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:49:18.082091 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.082072 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:49:18.092618 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.092600 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:49:18.102499 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.102477 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th8pw\" (UniqueName: \"kubernetes.io/projected/f90acceb-2024-451f-aa60-6e113c598de4-kube-api-access-th8pw\") pod \"network-check-target-hjjfh\" (UID: \"f90acceb-2024-451f-aa60-6e113c598de4\") " pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:49:18.192116 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.192092 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rrv2x\"" Jul 02 14:49:18.194200 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.194187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4w8l6" Jul 02 14:49:18.199944 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.199920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:49:18.323595 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.323565 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4w8l6"] Jul 02 14:49:18.326633 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:49:18.326608 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26531ce_4e76_43a8_aaf0_8ec9d45d0ddd.slice/crio-66027bc735e5288abad256232f873570c8f6e34e9c198568caee0921e62939ba WatchSource:0}: Error finding container 66027bc735e5288abad256232f873570c8f6e34e9c198568caee0921e62939ba: Status 404 returned error can't find the container with id 66027bc735e5288abad256232f873570c8f6e34e9c198568caee0921e62939ba Jul 02 14:49:18.341212 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.341193 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hjjfh"] Jul 02 14:49:18.342902 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:49:18.342874 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90acceb_2024_451f_aa60_6e113c598de4.slice/crio-31ba6c98a871c30cd6cc31483b4040abb2a2ce7e051b22ffe35f357456c185a4 WatchSource:0}: Error finding container 31ba6c98a871c30cd6cc31483b4040abb2a2ce7e051b22ffe35f357456c185a4: Status 404 returned error can't find the container with id 31ba6c98a871c30cd6cc31483b4040abb2a2ce7e051b22ffe35f357456c185a4 Jul 02 14:49:18.580765 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.580678 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4w8l6" event={"ID":"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd","Type":"ContainerStarted","Data":"66027bc735e5288abad256232f873570c8f6e34e9c198568caee0921e62939ba"} Jul 02 14:49:18.581713 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:18.581678 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hjjfh" event={"ID":"f90acceb-2024-451f-aa60-6e113c598de4","Type":"ContainerStarted","Data":"31ba6c98a871c30cd6cc31483b4040abb2a2ce7e051b22ffe35f357456c185a4"} Jul 02 14:49:21.809808 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:21.809780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:49:21.810120 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:21.809899 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:49:21.810120 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:21.809910 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:49:21.810120 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:21.809953 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:53.809939242 +0000 UTC m=+101.146995983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:49:21.910925 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:21.910887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:49:21.911103 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:21.910951 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:49:21.911103 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:21.911060 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:21.911103 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:21.911096 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:49:21.911281 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:21.911135 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:53.911115073 +0000 UTC m=+101.248171818 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:49:21.911281 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:21.911157 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:53.911147446 +0000 UTC m=+101.248204192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:49:22.596309 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:22.596267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hjjfh" event={"ID":"f90acceb-2024-451f-aa60-6e113c598de4","Type":"ContainerStarted","Data":"59baff6b355a7662fe5752f65a9873432e19669f274bb64d0f92bd2fba943dc8"} Jul 02 14:49:22.596574 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:22.596554 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:49:22.615686 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:22.615447 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hjjfh" podStartSLOduration=66.279348263 podStartE2EDuration="1m9.615430737s" totalImagesPullingTime="3.336082474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:22.614345162 +0000 UTC m=+69.951401939" watchObservedRunningTime="2026-07-02 14:49:22.615430737 +0000 UTC m=+69.952487503" Jul 02 14:49:24.604029 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:24.603998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4w8l6" event={"ID":"d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd","Type":"ContainerStarted","Data":"3b5fe967b31123d5bdebae482b4bab198342712fc4d649270bd85af1e245f914"} Jul 02 14:49:24.629699 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:24.629630 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4w8l6" podStartSLOduration=66.05465141 podStartE2EDuration="1m11.629615849s" totalImagesPullingTime="5.574964439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:24.629436771 +0000 UTC m=+71.966493535" watchObservedRunningTime="2026-07-02 14:49:24.629615849 +0000 UTC m=+71.966672591" Jul 02 14:49:26.924533 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:26.924490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:27.016773 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:27.016738 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:30.155749 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:30.155712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:30.215310 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:30.215273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:53.601493 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:53.601465 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hjjfh" Jul 02 14:49:53.844820 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:53.844788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:49:53.844994 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:53.844933 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:49:53.844994 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:53.844951 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:49:53.845083 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:53.845015 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:50:57.84500065 +0000 UTC m=+165.182057409 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:49:53.945846 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:53.945764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:49:53.945846 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:53.945809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:49:53.946021 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:53.945920 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:49:53.946021 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:53.945920 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:53.946021 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:53.945985 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:50:57.945967618 +0000 UTC m=+165.283024360 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:49:53.946021 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:49:53.945999 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:50:57.945993292 +0000 UTC m=+165.283050034 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:49:57.785845 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:57.785812 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:49:57.861471 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:49:57.861442 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:50:22.039081 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:50:22.039042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:50:22.039605 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:22.039207 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:50:22.039605 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:22.039300 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:52:24.039278745 +0000 UTC m=+251.376335492 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : secret "metrics-daemon-secret" not found Jul 02 14:50:52.984542 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:52.984499 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" podUID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" Jul 02 14:50:53.021000 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:53.020965 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" podUID="d8c73011-8f84-4c1d-b6e5-9eca8b57eb13" Jul 02 14:50:53.043254 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:53.043220 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tb4tg" podUID="e707e3de-1d9e-4adf-998b-64e3cc8cf201" Jul 02 14:50:53.853134 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:50:53.853101 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:50:53.853332 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:50:53.853101 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tb4tg" Jul 02 14:50:53.853332 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:50:53.853102 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:50:54.182475 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:54.182367 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:50:57.893910 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:50:57.893864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:50:57.894390 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:57.894043 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:50:57.894390 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:57.894070 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68886f9b4-c22t2: secret "image-registry-tls" not found Jul 02 14:50:57.894390 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:57.894161 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls podName:74e6ca4b-6e44-4e8a-bef6-496da1ba3318 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:59.894137098 +0000 UTC m=+287.231193857 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls") pod "image-registry-68886f9b4-c22t2" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318") : secret "image-registry-tls" not found Jul 02 14:50:57.995046 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:50:57.995001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:50:57.995046 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:50:57.995054 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:50:57.995253 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:57.995163 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:50:57.995253 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:57.995235 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls podName:e707e3de-1d9e-4adf-998b-64e3cc8cf201 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:59.995219889 +0000 UTC m=+287.332276652 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls") pod "dns-default-tb4tg" (UID: "e707e3de-1d9e-4adf-998b-64e3cc8cf201") : secret "dns-default-metrics-tls" not found Jul 02 14:50:57.995253 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:57.995166 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:50:57.995349 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:50:57.995270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:52:59.995262478 +0000 UTC m=+287.332319220 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:51:00.514708 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:00.514641 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" podUID="afccebd4-0aee-4f9c-b6a6-dee44a335087" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused" Jul 02 14:51:00.872717 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:00.872683 2559 generic.go:356] "Generic (PLEG): container finished" podID="0648468f-9f7a-4421-8711-b22fd23b5213" containerID="e7bdd6a37d5bf596f15e1d02a3718ed80d915b33e5b98519fc75f53261139ca5" exitCode=255 Jul 02 14:51:00.872895 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:00.872753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" event={"ID":"0648468f-9f7a-4421-8711-b22fd23b5213","Type":"ContainerDied","Data":"e7bdd6a37d5bf596f15e1d02a3718ed80d915b33e5b98519fc75f53261139ca5"} Jul 02 14:51:00.873100 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:00.873080 2559 scope.go:117] "RemoveContainer" containerID="e7bdd6a37d5bf596f15e1d02a3718ed80d915b33e5b98519fc75f53261139ca5" Jul 02 14:51:00.874165 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:00.874141 2559 generic.go:356] "Generic (PLEG): container finished" podID="afccebd4-0aee-4f9c-b6a6-dee44a335087" containerID="f69c78da48e2a2e1eff30b6dc9de30905100e87ee5609c14149d936ce5069e76" exitCode=1 Jul 02 14:51:00.874248 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:00.874189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" event={"ID":"afccebd4-0aee-4f9c-b6a6-dee44a335087","Type":"ContainerDied","Data":"f69c78da48e2a2e1eff30b6dc9de30905100e87ee5609c14149d936ce5069e76"} Jul 02 14:51:00.874470 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:00.874457 2559 scope.go:117] "RemoveContainer" containerID="f69c78da48e2a2e1eff30b6dc9de30905100e87ee5609c14149d936ce5069e76" Jul 02 14:51:01.879206 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:01.879167 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" event={"ID":"0648468f-9f7a-4421-8711-b22fd23b5213","Type":"ContainerStarted","Data":"5fd5533352dd758bec417cd67d75b9d51d7bcf1ae9d81247f852c7d04fd8e126"} Jul 02 14:51:01.884748 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:01.884720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" event={"ID":"afccebd4-0aee-4f9c-b6a6-dee44a335087","Type":"ContainerStarted","Data":"528406ecc2890d9271d7279bcb0bdbfa0404104caf6baee3b4c3814ee3f733cb"} Jul 02 14:51:01.885017 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:01.884998 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:51:01.885562 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:01.885544 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:51:07.152664 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:07.152560 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:51:38.879028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:51:38.878985 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:24.113536 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:24.113503 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:52:24.114041 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:24.113670 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:52:24.114041 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:24.113729 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs podName:035ab302-5ed4-4e18-9962-36620adfebde nodeName:}" failed. No retries permitted until 2026-07-02 14:54:26.113714897 +0000 UTC m=+373.450771640 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs") pod "network-metrics-daemon-n6vnp" (UID: "035ab302-5ed4-4e18-9962-36620adfebde") : secret "metrics-daemon-secret" not found Jul 02 14:52:44.346239 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:44.346116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:44.448338 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:44.448306 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:46.046250 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:46.046221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:46.100119 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:46.100069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:47.497197 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:47.497166 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:47.587873 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:47.587833 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:48.462227 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.462196 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2fs9p"] Jul 02 14:52:48.465182 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.465165 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.469044 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.469025 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 14:52:48.469145 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.469130 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 14:52:48.469262 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.469246 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9m28\"" Jul 02 14:52:48.469364 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.469348 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 14:52:48.470803 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.470783 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 14:52:48.482709 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.482681 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2fs9p"] Jul 02 14:52:48.527101 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.527072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:48.583121 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.583095 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.583214 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.583125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e05244e3-4287-4fb6-941c-bf2218fd57ca-data-volume\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.583251 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.583211 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6292\" (UniqueName: \"kubernetes.io/projected/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-api-access-k6292\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.583251 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.583242 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.583317 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.583267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e05244e3-4287-4fb6-941c-bf2218fd57ca-crio-socket\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.587162 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.587139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:48.684305 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.684281 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6292\" (UniqueName: \"kubernetes.io/projected/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-api-access-k6292\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.684394 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.684310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.684394 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.684333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e05244e3-4287-4fb6-941c-bf2218fd57ca-crio-socket\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.684493 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.684409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.684493 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:48.684430 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:48.684493 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.684431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e05244e3-4287-4fb6-941c-bf2218fd57ca-data-volume\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.684629 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:48.684505 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:52:49.184477407 +0000 UTC m=+276.521534151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:48.684629 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:48.684513 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:48.684629 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.684510 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e05244e3-4287-4fb6-941c-bf2218fd57ca-crio-socket\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.684629 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:48.684570 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:52:49.184560538 +0000 UTC m=+276.521617287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : configmap "kube-rbac-proxy" not found Jul 02 14:52:48.684832 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.684769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e05244e3-4287-4fb6-941c-bf2218fd57ca-data-volume\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.695276 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.695258 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6292\" (UniqueName: \"kubernetes.io/projected/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-api-access-k6292\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:48.980521 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:48.980491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:49.080583 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:49.080557 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:49.189182 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:49.189148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:49.189351 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:49.189231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:49.189351 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:49.189260 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:49.189351 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:49.189322 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:52:50.189300719 +0000 UTC m=+277.526357478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:49.189476 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:49.189357 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:49.189476 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:49.189428 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:52:50.189412692 +0000 UTC m=+277.526469433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : configmap "kube-rbac-proxy" not found Jul 02 14:52:49.250388 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:49.250311 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:50.155263 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:50.155232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:50.197694 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:50.197645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:50.197775 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:50.197730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:50.197775 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:50.197764 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:50.197840 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:50.197830 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:50.197870 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:50.197839 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:52:52.197824324 +0000 UTC m=+279.534881069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : configmap "kube-rbac-proxy" not found Jul 02 14:52:50.197870 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:50.197867 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:52:52.19785637 +0000 UTC m=+279.534913111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:50.254612 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:50.254576 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:50.455199 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:50.455126 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-frcsz_db06ba71-e44a-45f1-b291-7e8f944ce68d/dns-node-resolver/0.log" Jul 02 14:52:51.327459 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:51.327427 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:51.455506 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:51.455484 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrg9c_c426b758-6486-4602-8009-c551664c6a74/node-ca/0.log" Jul 02 14:52:52.055469 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:52.055441 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kvp9z_1e920e3e-fe66-4a55-a5ed-c0714de82f53/serve-healthcheck-canary/0.log" Jul 02 14:52:52.211598 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:52.211557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:52.211790 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:52.211621 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:52.211790 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:52.211702 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:52.211790 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:52.211721 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:52.211790 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:52.211753 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:52:56.211739872 +0000 UTC m=+283.548796613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : configmap "kube-rbac-proxy" not found Jul 02 14:52:52.211790 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:52.211772 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:52:56.211758144 +0000 UTC m=+283.548814885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:52.352238 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:52.352153 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:54.542209 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:54.542173 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:54.749151 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:54.749120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:54.849988 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:54.849908 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:54.950636 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:54.950597 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:55.051200 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:55.051171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:55.241729 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:55.241692 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:56.048150 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:56.048109 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:56.243607 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:56.243579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:56.243785 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:56.243642 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:52:56.243785 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:56.243709 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:56.243785 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:56.243763 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:53:04.243749476 +0000 UTC m=+291.580806241 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : configmap "kube-rbac-proxy" not found Jul 02 14:52:56.243891 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:56.243787 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:56.243891 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:56.243826 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:53:04.243815177 +0000 UTC m=+291.580871919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:56.655908 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:56.655872 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:56.852740 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:56.852703 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:56.853575 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:56.853551 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" podUID="d8c73011-8f84-4c1d-b6e5-9eca8b57eb13" Jul 02 14:52:56.853762 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:56.853735 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tb4tg" podUID="e707e3de-1d9e-4adf-998b-64e3cc8cf201" Jul 02 14:52:56.853809 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:52:56.853777 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" podUID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" Jul 02 14:52:56.945935 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:56.945865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:57.220468 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:57.220442 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:52:57.220468 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:57.220458 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tb4tg" Jul 02 14:52:57.220900 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:57.220442 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:52:58.044208 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:58.044164 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:58.142947 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:58.142917 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:58.432737 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:58.432626 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:58.494224 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:58.494193 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:58.665787 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:58.665750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:58.837377 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:58.837350 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:59.238184 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:59.238151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:59.436104 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:59.436069 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:52:59.970348 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:59.970317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:52:59.972753 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:52:59.972725 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"image-registry-68886f9b4-c22t2\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:53:00.042425 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.042388 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:00.071051 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.071018 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:53:00.071173 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.071059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:53:00.071173 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:00.071162 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 14:53:00.071243 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:00.071212 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert podName:d8c73011-8f84-4c1d-b6e5-9eca8b57eb13 nodeName:}" failed. No retries permitted until 2026-07-02 14:55:02.071198411 +0000 UTC m=+409.408255153 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-4p6bq" (UID: "d8c73011-8f84-4c1d-b6e5-9eca8b57eb13") : secret "networking-console-plugin-cert" not found Jul 02 14:53:00.073435 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.073415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e707e3de-1d9e-4adf-998b-64e3cc8cf201-metrics-tls\") pod \"dns-default-tb4tg\" (UID: \"e707e3de-1d9e-4adf-998b-64e3cc8cf201\") " pod="openshift-dns/dns-default-tb4tg" Jul 02 14:53:00.226319 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.226242 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gj4nd\"" Jul 02 14:53:00.226319 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.226242 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj2f4\"" Jul 02 14:53:00.232057 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.232033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:53:00.232166 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.232141 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tb4tg" Jul 02 14:53:00.367006 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.366986 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68886f9b4-c22t2"] Jul 02 14:53:00.368684 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:53:00.368643 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e6ca4b_6e44_4e8a_bef6_496da1ba3318.slice/crio-0b5171f35c3b4161aa6fe6a99deb0c904d8d6980d3c62a06c53f5da51056c8cf WatchSource:0}: Error finding container 0b5171f35c3b4161aa6fe6a99deb0c904d8d6980d3c62a06c53f5da51056c8cf: Status 404 returned error can't find the container with id 0b5171f35c3b4161aa6fe6a99deb0c904d8d6980d3c62a06c53f5da51056c8cf Jul 02 14:53:00.374120 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.374099 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tb4tg"] Jul 02 14:53:00.376323 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:53:00.376304 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode707e3de_1d9e_4adf_998b_64e3cc8cf201.slice/crio-4831bb57dc447964c58b1e61476ecb2d4dcceb5ee0a1693f276dfd2d4a313e89 WatchSource:0}: Error finding container 4831bb57dc447964c58b1e61476ecb2d4dcceb5ee0a1693f276dfd2d4a313e89: Status 404 returned error can't find the container with id 4831bb57dc447964c58b1e61476ecb2d4dcceb5ee0a1693f276dfd2d4a313e89 Jul 02 14:53:00.524207 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.524117 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:00.845091 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:00.845007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:01.234635 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.234597 2559 generic.go:356] "Generic (PLEG): container finished" podID="0648468f-9f7a-4421-8711-b22fd23b5213" containerID="5fd5533352dd758bec417cd67d75b9d51d7bcf1ae9d81247f852c7d04fd8e126" exitCode=255 Jul 02 14:53:01.234827 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.234677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" event={"ID":"0648468f-9f7a-4421-8711-b22fd23b5213","Type":"ContainerDied","Data":"5fd5533352dd758bec417cd67d75b9d51d7bcf1ae9d81247f852c7d04fd8e126"} Jul 02 14:53:01.234827 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.234726 2559 scope.go:117] "RemoveContainer" containerID="e7bdd6a37d5bf596f15e1d02a3718ed80d915b33e5b98519fc75f53261139ca5" Jul 02 14:53:01.235114 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.235095 2559 scope.go:117] "RemoveContainer" containerID="5fd5533352dd758bec417cd67d75b9d51d7bcf1ae9d81247f852c7d04fd8e126" Jul 02 14:53:01.235294 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:01.235270 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-74df6c567d-rpbh9_open-cluster-management-agent-addon(0648468f-9f7a-4421-8711-b22fd23b5213)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" podUID="0648468f-9f7a-4421-8711-b22fd23b5213" Jul 02 14:53:01.236875 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.236853 2559 generic.go:356] "Generic (PLEG): container finished" podID="afccebd4-0aee-4f9c-b6a6-dee44a335087" containerID="528406ecc2890d9271d7279bcb0bdbfa0404104caf6baee3b4c3814ee3f733cb" exitCode=1 Jul 02 14:53:01.236976 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.236926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" event={"ID":"afccebd4-0aee-4f9c-b6a6-dee44a335087","Type":"ContainerDied","Data":"528406ecc2890d9271d7279bcb0bdbfa0404104caf6baee3b4c3814ee3f733cb"} Jul 02 14:53:01.237269 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.237232 2559 scope.go:117] "RemoveContainer" containerID="528406ecc2890d9271d7279bcb0bdbfa0404104caf6baee3b4c3814ee3f733cb" Jul 02 14:53:01.237434 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:01.237407 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7598864cf6-bnnl5_open-cluster-management-agent-addon(afccebd4-0aee-4f9c-b6a6-dee44a335087)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" podUID="afccebd4-0aee-4f9c-b6a6-dee44a335087" Jul 02 14:53:01.238130 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.238110 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tb4tg" event={"ID":"e707e3de-1d9e-4adf-998b-64e3cc8cf201","Type":"ContainerStarted","Data":"4831bb57dc447964c58b1e61476ecb2d4dcceb5ee0a1693f276dfd2d4a313e89"} Jul 02 14:53:01.239829 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.239809 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" event={"ID":"74e6ca4b-6e44-4e8a-bef6-496da1ba3318","Type":"ContainerStarted","Data":"17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e"} Jul 02 14:53:01.239923 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.239845 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" event={"ID":"74e6ca4b-6e44-4e8a-bef6-496da1ba3318","Type":"ContainerStarted","Data":"0b5171f35c3b4161aa6fe6a99deb0c904d8d6980d3c62a06c53f5da51056c8cf"} Jul 02 14:53:01.239985 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.239953 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:53:01.247292 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.247216 2559 scope.go:117] "RemoveContainer" containerID="f69c78da48e2a2e1eff30b6dc9de30905100e87ee5609c14149d936ce5069e76" Jul 02 14:53:01.292090 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.292028 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" podStartSLOduration=288.292011094 podStartE2EDuration="4m48.292011094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:01.291279562 +0000 UTC m=+288.628336345" watchObservedRunningTime="2026-07-02 14:53:01.292011094 +0000 UTC m=+288.629067860" Jul 02 14:53:01.885018 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.884981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:01.885503 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.885053 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:53:01.985517 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:01.985483 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:02.232502 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:02.232465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:02.249603 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:02.249577 2559 scope.go:117] "RemoveContainer" containerID="528406ecc2890d9271d7279bcb0bdbfa0404104caf6baee3b4c3814ee3f733cb" Jul 02 14:53:02.249825 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:02.249794 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7598864cf6-bnnl5_open-cluster-management-agent-addon(afccebd4-0aee-4f9c-b6a6-dee44a335087)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" podUID="afccebd4-0aee-4f9c-b6a6-dee44a335087" Jul 02 14:53:02.250990 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:02.250969 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tb4tg" event={"ID":"e707e3de-1d9e-4adf-998b-64e3cc8cf201","Type":"ContainerStarted","Data":"fb2a86ccc65a18e3b68575ff17e56d8dfbc111535c427fc30916a210b9cd8f6b"} Jul 02 14:53:02.251157 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:02.251144 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tb4tg" Jul 02 14:53:02.251204 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:02.251175 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tb4tg" event={"ID":"e707e3de-1d9e-4adf-998b-64e3cc8cf201","Type":"ContainerStarted","Data":"9a7ebe10d76160740427882af4f7b6db9121c9f19da0627d4ec2e04cd3a94c8a"} Jul 02 14:53:02.283567 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:02.283516 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tb4tg" podStartSLOduration=251.655673597 podStartE2EDuration="4m13.283501105s" totalImagesPullingTime="1.627827508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:02.282971342 +0000 UTC m=+289.620028120" watchObservedRunningTime="2026-07-02 14:53:02.283501105 +0000 UTC m=+289.620557846" Jul 02 14:53:02.436092 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:02.435996 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:02.641543 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:02.641507 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:03.041104 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:03.041068 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:03.642793 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:03.642751 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:03.922263 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:03.922160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:04.243258 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:04.243223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:04.304305 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:04.304268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:53:04.304475 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:04.304340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:53:04.304475 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:04.304422 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:53:04.304543 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:04.304501 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls podName:e05244e3-4287-4fb6-941c-bf2218fd57ca nodeName:}" failed. No retries permitted until 2026-07-02 14:53:20.304484478 +0000 UTC m=+307.641541233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2fs9p" (UID: "e05244e3-4287-4fb6-941c-bf2218fd57ca") : secret "insights-runtime-extractor-tls" not found Jul 02 14:53:04.304971 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:04.304953 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e05244e3-4287-4fb6-941c-bf2218fd57ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:53:04.437159 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:04.437129 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:04.645639 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:04.645543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:05.038808 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:05.038772 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:05.242287 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:05.242250 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:10.153718 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:10.153672 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-n6vnp" podUID="035ab302-5ed4-4e18-9962-36620adfebde" Jul 02 14:53:10.305264 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:10.305231 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:53:10.305558 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:10.305546 2559 scope.go:117] "RemoveContainer" containerID="528406ecc2890d9271d7279bcb0bdbfa0404104caf6baee3b4c3814ee3f733cb" Jul 02 14:53:10.305722 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:10.305704 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7598864cf6-bnnl5_open-cluster-management-agent-addon(afccebd4-0aee-4f9c-b6a6-dee44a335087)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" podUID="afccebd4-0aee-4f9c-b6a6-dee44a335087" Jul 02 14:53:10.356709 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:10.356679 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" Jul 02 14:53:10.357026 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:10.357010 2559 scope.go:117] "RemoveContainer" containerID="5fd5533352dd758bec417cd67d75b9d51d7bcf1ae9d81247f852c7d04fd8e126" Jul 02 14:53:10.357185 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:53:10.357165 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-74df6c567d-rpbh9_open-cluster-management-agent-addon(0648468f-9f7a-4421-8711-b22fd23b5213)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" podUID="0648468f-9f7a-4421-8711-b22fd23b5213" Jul 02 14:53:12.256336 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:12.256306 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tb4tg" Jul 02 14:53:12.489043 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:12.489009 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:12.583235 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:12.583148 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:13.079444 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:13.079417 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 14:53:13.081188 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:13.081164 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 14:53:13.081610 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:13.081594 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 14:53:13.996389 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:13.996354 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:14.048363 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:14.048333 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:19.704980 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:19.704947 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:20.235981 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:20.235950 2559 patch_prober.go:28] interesting pod/image-registry-68886f9b4-c22t2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 14:53:20.236141 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:20.236007 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" podUID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 14:53:20.324201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:20.324164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:53:20.326629 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:20.326604 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e05244e3-4287-4fb6-941c-bf2218fd57ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2fs9p\" (UID: \"e05244e3-4287-4fb6-941c-bf2218fd57ca\") " pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:53:20.577343 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:20.577260 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9m28\"" Jul 02 14:53:20.584803 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:20.584779 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2fs9p" Jul 02 14:53:20.710605 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:20.710559 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2fs9p"] Jul 02 14:53:20.712610 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:53:20.712578 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05244e3_4287_4fb6_941c_bf2218fd57ca.slice/crio-a4f8cf2b38b8137b49c8c1f01d3f14bd4692e4cc46c9916089c8df5ab9d86eba WatchSource:0}: Error finding container a4f8cf2b38b8137b49c8c1f01d3f14bd4692e4cc46c9916089c8df5ab9d86eba: Status 404 returned error can't find the container with id a4f8cf2b38b8137b49c8c1f01d3f14bd4692e4cc46c9916089c8df5ab9d86eba Jul 02 14:53:20.713719 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:20.713702 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:53:21.153859 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:21.153565 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:53:21.306965 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:21.306928 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2fs9p" event={"ID":"e05244e3-4287-4fb6-941c-bf2218fd57ca","Type":"ContainerStarted","Data":"a4f8cf2b38b8137b49c8c1f01d3f14bd4692e4cc46c9916089c8df5ab9d86eba"} Jul 02 14:53:21.808102 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:21.808062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:21.860850 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:21.860793 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:22.153722 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:22.153592 2559 scope.go:117] "RemoveContainer" containerID="528406ecc2890d9271d7279bcb0bdbfa0404104caf6baee3b4c3814ee3f733cb" Jul 02 14:53:22.256215 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:22.256187 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:53:22.423098 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:22.422994 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:22.525063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:22.525020 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:22.943892 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:22.943856 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:23.071418 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:23.071385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:23.328381 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:23.328344 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:24.153146 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:24.153115 2559 scope.go:117] "RemoveContainer" containerID="5fd5533352dd758bec417cd67d75b9d51d7bcf1ae9d81247f852c7d04fd8e126" Jul 02 14:53:25.320495 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:25.320403 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2fs9p" event={"ID":"e05244e3-4287-4fb6-941c-bf2218fd57ca","Type":"ContainerStarted","Data":"5c1863b95794009efd64a880ad0fa5df85d9bbcddeed77b212fb5e6008b03676"} Jul 02 14:53:25.320495 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:25.320463 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2fs9p" event={"ID":"e05244e3-4287-4fb6-941c-bf2218fd57ca","Type":"ContainerStarted","Data":"13ea614ed3bb1403242eab5039356652b2ee6a5ac4219e04c18922484a1d3c49"} Jul 02 14:53:25.322127 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:25.322107 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74df6c567d-rpbh9" event={"ID":"0648468f-9f7a-4421-8711-b22fd23b5213","Type":"ContainerStarted","Data":"802629a4d7e157eeb18dc9bac494619b4a92f1b7f71172873148159f68b56353"} Jul 02 14:53:25.323804 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:25.323772 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" event={"ID":"afccebd4-0aee-4f9c-b6a6-dee44a335087","Type":"ContainerStarted","Data":"ea62e9b4e1731789a06a35b2ad57fb20185a1a2f27d24ff9edb4cedb9e0f5b89"} Jul 02 14:53:25.324048 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:25.324031 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:53:25.325600 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:25.325580 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7598864cf6-bnnl5" Jul 02 14:53:25.770531 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:25.770496 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:25.837029 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:25.836988 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:28.336592 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:28.336556 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2fs9p" event={"ID":"e05244e3-4287-4fb6-941c-bf2218fd57ca","Type":"ContainerStarted","Data":"704af5e8a700991dbd6cd6441710a0670ccd6b88b401356bf4ffc664ba118c5d"} Jul 02 14:53:28.355062 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:28.355013 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2fs9p" podStartSLOduration=33.378760324 podStartE2EDuration="40.354999412s" totalImagesPullingTime="6.976239088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:52:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:28.354424465 +0000 UTC m=+315.691481256" watchObservedRunningTime="2026-07-02 14:53:28.354999412 +0000 UTC m=+315.692056192" Jul 02 14:53:28.931728 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:28.931693 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:29.029560 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:29.029524 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:29.236421 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:29.236381 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:29.385514 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:29.385481 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:29.485432 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:29.485398 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:29.586359 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:29.586273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:29.686803 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:29.686766 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:30.482450 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:30.482411 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:30.583326 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:30.583292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:30.847976 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:30.847868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:31.005990 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.005958 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:31.108875 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.108785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:31.263545 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.263509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:31.406260 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.406175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:31.509416 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.509389 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kbxnd"] Jul 02 14:53:31.512541 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.512526 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.517712 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.517673 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:31.525019 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.525004 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 14:53:31.526563 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.526546 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 14:53:31.526634 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.526613 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 14:53:31.526742 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.526728 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 14:53:31.526808 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.526794 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 14:53:31.527273 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.527261 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 14:53:31.527333 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.527323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9ks79\"" Jul 02 14:53:31.617044 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617013 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-textfile\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.617169 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617047 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-sys\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.617169 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b82fa703-d3e3-40eb-9f0a-6b33a407256c-metrics-client-ca\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.617169 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.617270 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.617270 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617208 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-tls\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.617270 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m7kn\" (UniqueName: \"kubernetes.io/projected/b82fa703-d3e3-40eb-9f0a-6b33a407256c-kube-api-access-2m7kn\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.617270 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-wtmp\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.617401 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.617319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-root\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.669881 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.669813 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:31.718032 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718007 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718136 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-tls\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718136 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718061 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m7kn\" (UniqueName: \"kubernetes.io/projected/b82fa703-d3e3-40eb-9f0a-6b33a407256c-kube-api-access-2m7kn\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718136 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-wtmp\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718248 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-wtmp\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718248 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-root\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718322 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-root\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718322 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-textfile\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718322 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718298 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-sys\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718428 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b82fa703-d3e3-40eb-9f0a-6b33a407256c-metrics-client-ca\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718428 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718428 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718374 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b82fa703-d3e3-40eb-9f0a-6b33a407256c-sys\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718622 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-textfile\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.718965 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b82fa703-d3e3-40eb-9f0a-6b33a407256c-metrics-client-ca\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.719035 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.718946 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.720425 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.720400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-tls\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.720559 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.720542 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b82fa703-d3e3-40eb-9f0a-6b33a407256c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.730784 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.730765 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m7kn\" (UniqueName: \"kubernetes.io/projected/b82fa703-d3e3-40eb-9f0a-6b33a407256c-kube-api-access-2m7kn\") pod \"node-exporter-kbxnd\" (UID: \"b82fa703-d3e3-40eb-9f0a-6b33a407256c\") " pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.821548 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.821518 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kbxnd" Jul 02 14:53:31.833090 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:53:31.833058 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82fa703_d3e3_40eb_9f0a_6b33a407256c.slice/crio-3e0f5d3ffd6f89ca4236aa7a5a3d3ba08d3114c1e9cc5ce37e10455ab6f8d1cc WatchSource:0}: Error finding container 3e0f5d3ffd6f89ca4236aa7a5a3d3ba08d3114c1e9cc5ce37e10455ab6f8d1cc: Status 404 returned error can't find the container with id 3e0f5d3ffd6f89ca4236aa7a5a3d3ba08d3114c1e9cc5ce37e10455ab6f8d1cc Jul 02 14:53:31.938412 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:31.938323 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:32.321201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:32.321169 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:32.353231 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:32.353196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbxnd" event={"ID":"b82fa703-d3e3-40eb-9f0a-6b33a407256c","Type":"ContainerStarted","Data":"3e0f5d3ffd6f89ca4236aa7a5a3d3ba08d3114c1e9cc5ce37e10455ab6f8d1cc"} Jul 02 14:53:32.424923 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:32.424805 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:32.499465 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:32.499428 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:33.357365 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:33.357325 2559 generic.go:356] "Generic (PLEG): container finished" podID="b82fa703-d3e3-40eb-9f0a-6b33a407256c" containerID="41525ff9405329f426a09df0b676a272a586b59cd04f37739d1bc436496bb3fa" exitCode=0 Jul 02 14:53:33.357789 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:33.357409 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbxnd" event={"ID":"b82fa703-d3e3-40eb-9f0a-6b33a407256c","Type":"ContainerDied","Data":"41525ff9405329f426a09df0b676a272a586b59cd04f37739d1bc436496bb3fa"} Jul 02 14:53:34.323088 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.323054 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:34.362958 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.362926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbxnd" event={"ID":"b82fa703-d3e3-40eb-9f0a-6b33a407256c","Type":"ContainerStarted","Data":"33b6d83c9a4f50528e53e36c5bbb86ed7369e1e22ebf83a84c402073b8c3b3db"} Jul 02 14:53:34.363325 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.362980 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbxnd" event={"ID":"b82fa703-d3e3-40eb-9f0a-6b33a407256c","Type":"ContainerStarted","Data":"d53169e6f9d0e95dacfa11cf4f54f0679409a05d034964d6e214c7d04c41f1b1"} Jul 02 14:53:34.392591 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.392541 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kbxnd" podStartSLOduration=2.38823396 podStartE2EDuration="3.392524569s" totalImagesPullingTime="934.551724ms" totalInitContainerRuntime="69.738885ms" isStatefulPod=true podCreationTimestamp="2026-07-02 14:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:34.390307967 +0000 UTC m=+321.727364749" watchObservedRunningTime="2026-07-02 14:53:34.392524569 +0000 UTC m=+321.729581333" Jul 02 14:53:34.413154 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.413121 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:34.481614 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.481578 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68886f9b4-c22t2"] Jul 02 14:53:34.569203 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.569175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:34.687341 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.687252 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:34.790915 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:34.790878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:35.045928 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:35.045888 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:35.141477 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:35.141442 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:36.120766 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:36.120730 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:36.221018 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:36.220981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:36.345803 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:36.345757 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:37.673072 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:37.673038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:39.486028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:39.485977 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:39.598615 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:39.598582 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:40.814115 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:40.814079 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:40.916900 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:40.916871 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:43.212692 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:43.212661 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:46.678434 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:46.678393 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:48.150951 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:48.150916 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:48.252493 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:48.252455 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:48.464562 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:48.464534 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:48.566295 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:48.566262 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:52.820163 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:52.820119 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:52.883225 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:52.883195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:57.856063 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:57.856018 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:57.957875 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:57.957840 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:58.181249 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:58.181140 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:58.276220 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:58.276188 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:58.993286 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:58.993253 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:59.046118 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.046087 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:53:59.501465 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.501432 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" podUID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" containerName="registry" containerID="cri-o://17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e" gracePeriod=30 Jul 02 14:53:59.738687 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.738642 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:53:59.831452 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831338 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-certificates\") pod \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " Jul 02 14:53:59.831452 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831396 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-ca-trust-extracted\") pod \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " Jul 02 14:53:59.831452 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831431 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-trusted-ca\") pod \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " Jul 02 14:53:59.831452 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831462 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9pww\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-kube-api-access-k9pww\") pod \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " Jul 02 14:53:59.831825 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831493 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-image-registry-private-configuration\") pod \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " Jul 02 14:53:59.831825 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831513 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-bound-sa-token\") pod \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " Jul 02 14:53:59.831825 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831533 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") pod \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " Jul 02 14:53:59.831825 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831557 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-installation-pull-secrets\") pod \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\" (UID: \"74e6ca4b-6e44-4e8a-bef6-496da1ba3318\") " Jul 02 14:53:59.832090 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831896 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "74e6ca4b-6e44-4e8a-bef6-496da1ba3318" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:53:59.832090 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.831909 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "74e6ca4b-6e44-4e8a-bef6-496da1ba3318" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:53:59.834449 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.834393 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74e6ca4b-6e44-4e8a-bef6-496da1ba3318" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:53:59.834585 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.834444 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "74e6ca4b-6e44-4e8a-bef6-496da1ba3318" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:53:59.834585 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.834479 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "74e6ca4b-6e44-4e8a-bef6-496da1ba3318" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:53:59.834585 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.834573 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "74e6ca4b-6e44-4e8a-bef6-496da1ba3318" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:53:59.834733 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.834683 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-kube-api-access-k9pww" (OuterVolumeSpecName: "kube-api-access-k9pww") pod "74e6ca4b-6e44-4e8a-bef6-496da1ba3318" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318"). InnerVolumeSpecName "kube-api-access-k9pww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:53:59.840090 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.840066 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "74e6ca4b-6e44-4e8a-bef6-496da1ba3318" (UID: "74e6ca4b-6e44-4e8a-bef6-496da1ba3318"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:53:59.932253 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.932209 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-trusted-ca\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:53:59.932253 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.932250 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9pww\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-kube-api-access-k9pww\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:53:59.932253 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.932261 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-image-registry-private-configuration\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:53:59.932253 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.932271 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-bound-sa-token\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:53:59.932503 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.932281 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-tls\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:53:59.932503 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.932289 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-installation-pull-secrets\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:53:59.932503 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.932296 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-registry-certificates\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:53:59.932503 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:53:59.932305 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e6ca4b-6e44-4e8a-bef6-496da1ba3318-ca-trust-extracted\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:54:00.454174 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.454141 2559 generic.go:356] "Generic (PLEG): container finished" podID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" containerID="17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e" exitCode=0 Jul 02 14:54:00.454591 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.454198 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" Jul 02 14:54:00.454591 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.454228 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" event={"ID":"74e6ca4b-6e44-4e8a-bef6-496da1ba3318","Type":"ContainerDied","Data":"17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e"} Jul 02 14:54:00.454591 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.454304 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68886f9b4-c22t2" event={"ID":"74e6ca4b-6e44-4e8a-bef6-496da1ba3318","Type":"ContainerDied","Data":"0b5171f35c3b4161aa6fe6a99deb0c904d8d6980d3c62a06c53f5da51056c8cf"} Jul 02 14:54:00.454591 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.454325 2559 scope.go:117] "RemoveContainer" containerID="17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e" Jul 02 14:54:00.462469 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.462452 2559 scope.go:117] "RemoveContainer" containerID="17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e" Jul 02 14:54:00.462762 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:54:00.462743 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e\": container with ID starting with 17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e not found: ID does not exist" containerID="17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e" Jul 02 14:54:00.462827 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.462772 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e"} err="failed to get container status \"17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e\": rpc error: code = NotFound desc = could not find container \"17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e\": container with ID starting with 17d059db02ed328382ce8534c0ae67160b258ff561d01c6b826adf5f24cf1b8e not found: ID does not exist" Jul 02 14:54:00.474744 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.474722 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68886f9b4-c22t2"] Jul 02 14:54:00.477308 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:00.477284 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68886f9b4-c22t2"] Jul 02 14:54:01.156975 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:01.156944 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" path="/var/lib/kubelet/pods/74e6ca4b-6e44-4e8a-bef6-496da1ba3318/volumes" Jul 02 14:54:09.170937 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:09.170857 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kvp9z_1e920e3e-fe66-4a55-a5ed-c0714de82f53/serve-healthcheck-canary/0.log" Jul 02 14:54:13.995588 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:13.995535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:14.150843 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:14.150808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:20.338043 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:20.337998 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" podUID="a4afca32-45f3-4cc2-9077-8252d5afc34f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 14:54:23.203200 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:23.203160 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:23.272208 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:23.272175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:26.131407 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:26.131357 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:54:26.133838 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:26.133816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/035ab302-5ed4-4e18-9962-36620adfebde-metrics-certs\") pod \"network-metrics-daemon-n6vnp\" (UID: \"035ab302-5ed4-4e18-9962-36620adfebde\") " pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:54:26.257201 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:26.257171 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wp67j\"" Jul 02 14:54:26.264782 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:26.264766 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n6vnp" Jul 02 14:54:26.387086 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:26.387064 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n6vnp"] Jul 02 14:54:26.388846 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:54:26.388812 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035ab302_5ed4_4e18_9962_36620adfebde.slice/crio-b83938dfae73f532364900bb861986bb75dd9b1a1766f50fc0634afa40494390 WatchSource:0}: Error finding container b83938dfae73f532364900bb861986bb75dd9b1a1766f50fc0634afa40494390: Status 404 returned error can't find the container with id b83938dfae73f532364900bb861986bb75dd9b1a1766f50fc0634afa40494390 Jul 02 14:54:26.536711 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:26.536681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6vnp" event={"ID":"035ab302-5ed4-4e18-9962-36620adfebde","Type":"ContainerStarted","Data":"b83938dfae73f532364900bb861986bb75dd9b1a1766f50fc0634afa40494390"} Jul 02 14:54:27.540782 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:27.540760 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6vnp" event={"ID":"035ab302-5ed4-4e18-9962-36620adfebde","Type":"ContainerStarted","Data":"57eaf4675d2455db1850501ce112ab3950d40387742aded77937c523892790ae"} Jul 02 14:54:28.546290 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:28.546253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n6vnp" event={"ID":"035ab302-5ed4-4e18-9962-36620adfebde","Type":"ContainerStarted","Data":"970280bd508f02a19252109dbdf58121eb4697af60186a944fc4a84371e7ef75"} Jul 02 14:54:28.567463 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:28.567414 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n6vnp" podStartSLOduration=374.577933336 podStartE2EDuration="6m15.567399536s" totalImagesPullingTime="989.4662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:54:28.565333128 +0000 UTC m=+375.902389892" watchObservedRunningTime="2026-07-02 14:54:28.567399536 +0000 UTC m=+375.904456299" Jul 02 14:54:28.665668 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:28.665621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:28.766613 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:28.766580 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:28.830908 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:28.830831 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:30.337693 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:30.337636 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" podUID="a4afca32-45f3-4cc2-9077-8252d5afc34f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 14:54:34.513503 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:34.513471 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:34.572771 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:34.572739 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:40.337622 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:40.337587 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" podUID="a4afca32-45f3-4cc2-9077-8252d5afc34f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 02 14:54:40.338104 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:40.337671 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" Jul 02 14:54:40.338208 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:40.338190 2559 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b6140478c339a388e7a4d0b9aafa06ea6eefddc40e5188291d17d8785e0376d0"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 02 14:54:40.338246 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:40.338232 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" podUID="a4afca32-45f3-4cc2-9077-8252d5afc34f" containerName="service-proxy" containerID="cri-o://b6140478c339a388e7a4d0b9aafa06ea6eefddc40e5188291d17d8785e0376d0" gracePeriod=30 Jul 02 14:54:40.588391 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:40.588309 2559 generic.go:356] "Generic (PLEG): container finished" podID="a4afca32-45f3-4cc2-9077-8252d5afc34f" containerID="b6140478c339a388e7a4d0b9aafa06ea6eefddc40e5188291d17d8785e0376d0" exitCode=2 Jul 02 14:54:40.588391 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:40.588357 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" event={"ID":"a4afca32-45f3-4cc2-9077-8252d5afc34f","Type":"ContainerDied","Data":"b6140478c339a388e7a4d0b9aafa06ea6eefddc40e5188291d17d8785e0376d0"} Jul 02 14:54:40.588546 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:40.588404 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8498cc7cd9-9xpmf" event={"ID":"a4afca32-45f3-4cc2-9077-8252d5afc34f","Type":"ContainerStarted","Data":"f1cd3c46f80f21ef8be388080586e0aa19a684d68dbbae8c28ae6e11ba1de039"} Jul 02 14:54:41.946635 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:41.946596 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:42.005018 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:42.004989 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:49.924024 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:49.923981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:50.660049 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:50.660011 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:51.276188 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:51.276148 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:54:59.890233 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:54:59.890190 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:00.080633 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:00.080586 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:00.182105 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:00.182022 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:00.222046 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:55:00.222001 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" podUID="d8c73011-8f84-4c1d-b6e5-9eca8b57eb13" Jul 02 14:55:00.621518 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:00.621479 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:00.654765 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:00.654739 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:55:00.722314 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:00.722282 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:02.088181 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:02.088147 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:55:02.090580 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:02.090555 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d8c73011-8f84-4c1d-b6e5-9eca8b57eb13-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-4p6bq\" (UID: \"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:55:02.158816 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:02.158782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-p4nnm\"" Jul 02 14:55:02.166511 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:02.166493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" Jul 02 14:55:02.295406 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:02.295365 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq"] Jul 02 14:55:02.297453 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:55:02.297427 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c73011_8f84_4c1d_b6e5_9eca8b57eb13.slice/crio-594fe3e16396d5b63b0843f25c53c7121d20723b32b8704b03bae0998c43bc7d WatchSource:0}: Error finding container 594fe3e16396d5b63b0843f25c53c7121d20723b32b8704b03bae0998c43bc7d: Status 404 returned error can't find the container with id 594fe3e16396d5b63b0843f25c53c7121d20723b32b8704b03bae0998c43bc7d Jul 02 14:55:02.662271 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:02.662242 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" event={"ID":"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13","Type":"ContainerStarted","Data":"594fe3e16396d5b63b0843f25c53c7121d20723b32b8704b03bae0998c43bc7d"} Jul 02 14:55:04.670770 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:04.670728 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" event={"ID":"d8c73011-8f84-4c1d-b6e5-9eca8b57eb13","Type":"ContainerStarted","Data":"691430fbcf6cf267466aceaa095a88597f89d4688e9bfa7970a1c679e55b115a"} Jul 02 14:55:04.687401 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:04.687346 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-4p6bq" podStartSLOduration=387.091179279 podStartE2EDuration="6m28.687327938s" totalImagesPullingTime="1.596148659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:55:04.687108443 +0000 UTC m=+412.024165227" watchObservedRunningTime="2026-07-02 14:55:04.687327938 +0000 UTC m=+412.024384700" Jul 02 14:55:04.850487 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:04.850450 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:04.914546 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:04.914513 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:11.132688 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:11.132637 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:11.397492 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:11.397394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:11.452807 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:11.452773 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:12.243524 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:12.243495 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:39.419529 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:39.419446 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:39.473028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:39.472993 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:55:51.059179 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:55:51.059139 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:05.954672 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:05.954617 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:06.007594 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:06.007559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:17.938558 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:17.938520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:18.051221 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:18.051181 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:29.056036 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:29.056000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:29.161821 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:29.161783 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:29.252834 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:29.252791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:29.464588 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:29.464558 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:40.544371 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:40.544330 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:40.645146 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:40.645116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:56:40.744635 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:56:40.744591 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:04.811842 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:04.811765 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:18.576563 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:18.576525 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:18.700410 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:18.700373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:45.604600 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:45.604560 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:46.581721 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:46.581669 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:49.211929 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:49.211902 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:49.315096 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:49.315064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:50.281075 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:50.281042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:50.504301 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:50.504264 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:51.394189 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:51.394158 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:51.643044 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:51.643007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:53.465010 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:53.464968 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:53.876210 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:53.876107 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:55.788177 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:55.788140 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:57:55.860127 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:57:55.860092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:01.470594 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:01.470559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:03.216881 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:03.216843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:03.287002 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:03.286970 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:09.017905 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:09.017865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:09.119890 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:09.119856 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:11.119574 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:11.119546 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:13.103345 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:13.103321 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 14:58:13.104039 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:13.104020 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 14:58:18.333030 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:18.332995 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:26.421456 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:26.421419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:27.675686 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.675633 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j"] Jul 02 14:58:27.676048 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.675868 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" containerName="registry" Jul 02 14:58:27.676048 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.675878 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" containerName="registry" Jul 02 14:58:27.676048 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.675923 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e6ca4b-6e44-4e8a-bef6-496da1ba3318" containerName="registry" Jul 02 14:58:27.678685 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.678668 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.681933 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.681901 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 14:58:27.682051 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.681947 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 14:58:27.682051 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.681961 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pkwmq\"" Jul 02 14:58:27.682051 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.681978 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 14:58:27.682321 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.682305 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 14:58:27.687123 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.687101 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11c305e3-f541-47e4-a077-e10d0600f3c0-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.687215 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.687130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11c305e3-f541-47e4-a077-e10d0600f3c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.687215 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.687163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11c305e3-f541-47e4-a077-e10d0600f3c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.687215 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.687210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp8dr\" (UniqueName: \"kubernetes.io/projected/11c305e3-f541-47e4-a077-e10d0600f3c0-kube-api-access-dp8dr\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.687316 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.687231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11c305e3-f541-47e4-a077-e10d0600f3c0-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.693293 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.693271 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j"] Jul 02 14:58:27.788336 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.788304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11c305e3-f541-47e4-a077-e10d0600f3c0-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.788336 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.788343 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11c305e3-f541-47e4-a077-e10d0600f3c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.788608 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.788415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11c305e3-f541-47e4-a077-e10d0600f3c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.788608 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.788451 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp8dr\" (UniqueName: \"kubernetes.io/projected/11c305e3-f541-47e4-a077-e10d0600f3c0-kube-api-access-dp8dr\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.788608 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.788476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11c305e3-f541-47e4-a077-e10d0600f3c0-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.788810 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.788740 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11c305e3-f541-47e4-a077-e10d0600f3c0-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.790879 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.790845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11c305e3-f541-47e4-a077-e10d0600f3c0-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.791003 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.790951 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11c305e3-f541-47e4-a077-e10d0600f3c0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.791077 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.791061 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11c305e3-f541-47e4-a077-e10d0600f3c0-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.798756 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.798728 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp8dr\" (UniqueName: \"kubernetes.io/projected/11c305e3-f541-47e4-a077-e10d0600f3c0-kube-api-access-dp8dr\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-nd24j\" (UID: \"11c305e3-f541-47e4-a077-e10d0600f3c0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:27.988006 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:27.987979 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:28.020160 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:28.020126 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:28.134004 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:28.133957 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j"] Jul 02 14:58:28.134256 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:28.134215 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:28.137520 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:58:28.137502 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c305e3_f541_47e4_a077_e10d0600f3c0.slice/crio-dc076d3180c14f1c7f94a30532dfbe8d86df3eaa5ca8f55632b8b9f3b482dec2 WatchSource:0}: Error finding container dc076d3180c14f1c7f94a30532dfbe8d86df3eaa5ca8f55632b8b9f3b482dec2: Status 404 returned error can't find the container with id dc076d3180c14f1c7f94a30532dfbe8d86df3eaa5ca8f55632b8b9f3b482dec2 Jul 02 14:58:28.139155 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:28.139141 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:58:28.272319 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:28.272223 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:28.319198 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:28.319164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" event={"ID":"11c305e3-f541-47e4-a077-e10d0600f3c0","Type":"ContainerStarted","Data":"dc076d3180c14f1c7f94a30532dfbe8d86df3eaa5ca8f55632b8b9f3b482dec2"} Jul 02 14:58:28.366769 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:28.366743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:31.334713 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:31.334682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" event={"ID":"11c305e3-f541-47e4-a077-e10d0600f3c0","Type":"ContainerStarted","Data":"ba2fd9dadee9297a7ac1b0054906ba59948a017b45e454fa6ccaf9666895d0c5"} Jul 02 14:58:32.339607 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:32.339573 2559 generic.go:356] "Generic (PLEG): container finished" podID="11c305e3-f541-47e4-a077-e10d0600f3c0" containerID="ba2fd9dadee9297a7ac1b0054906ba59948a017b45e454fa6ccaf9666895d0c5" exitCode=0 Jul 02 14:58:32.340046 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:32.339632 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" event={"ID":"11c305e3-f541-47e4-a077-e10d0600f3c0","Type":"ContainerDied","Data":"ba2fd9dadee9297a7ac1b0054906ba59948a017b45e454fa6ccaf9666895d0c5"} Jul 02 14:58:33.346433 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:33.346397 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" event={"ID":"11c305e3-f541-47e4-a077-e10d0600f3c0","Type":"ContainerStarted","Data":"c97871eebc1a610b6af7c1dabb7499eb769663a8dfa53e01652caaede49be0b3"} Jul 02 14:58:33.346927 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:33.346528 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:33.371894 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:33.371776 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" podStartSLOduration=1.9046229540000001 podStartE2EDuration="6.371761647s" totalImagesPullingTime="3.438211022s" totalInitContainerRuntime="1.028927671s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:33.370265471 +0000 UTC m=+620.707322237" watchObservedRunningTime="2026-07-02 14:58:33.371761647 +0000 UTC m=+620.708818401" Jul 02 14:58:35.586876 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:35.586797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:35.734961 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:35.734930 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:42.403185 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:42.403146 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:44.246510 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:44.246477 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:44.347162 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:44.347125 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:44.352206 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:44.352179 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-nd24j" Jul 02 14:58:46.424476 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:46.424443 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:46.550487 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:46.550446 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:47.068776 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.068744 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-685b948f4-nxwnv"] Jul 02 14:58:47.074493 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.074472 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.081471 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.081449 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 14:58:47.081471 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.081475 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 14:58:47.081627 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.081485 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 14:58:47.087129 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.087106 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 14:58:47.094340 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.094316 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:47.097427 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.097407 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685b948f4-nxwnv"] Jul 02 14:58:47.127229 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.127205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkt2\" (UniqueName: \"kubernetes.io/projected/61932201-db8c-4f90-9476-5e0f752a0b09-kube-api-access-cbkt2\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.127407 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.127256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61932201-db8c-4f90-9476-5e0f752a0b09-tls-certs\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.127407 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.127291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61932201-db8c-4f90-9476-5e0f752a0b09-tmp\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.228286 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.228246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61932201-db8c-4f90-9476-5e0f752a0b09-tmp\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.228286 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.228292 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkt2\" (UniqueName: \"kubernetes.io/projected/61932201-db8c-4f90-9476-5e0f752a0b09-kube-api-access-cbkt2\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.228524 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.228356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61932201-db8c-4f90-9476-5e0f752a0b09-tls-certs\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.228524 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:58:47.228461 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 02 14:58:47.228631 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:58:47.228535 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61932201-db8c-4f90-9476-5e0f752a0b09-tls-certs podName:61932201-db8c-4f90-9476-5e0f752a0b09 nodeName:}" failed. No retries permitted until 2026-07-02 14:58:47.728512194 +0000 UTC m=+635.065568951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/61932201-db8c-4f90-9476-5e0f752a0b09-tls-certs") pod "kube-auth-proxy-685b948f4-nxwnv" (UID: "61932201-db8c-4f90-9476-5e0f752a0b09") : secret "kube-auth-proxy-tls" not found Jul 02 14:58:47.230914 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.230887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61932201-db8c-4f90-9476-5e0f752a0b09-tmp\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.250826 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.250763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkt2\" (UniqueName: \"kubernetes.io/projected/61932201-db8c-4f90-9476-5e0f752a0b09-kube-api-access-cbkt2\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.326141 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.326062 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kn77n"] Jul 02 14:58:47.328133 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.328114 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:47.331140 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.331111 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 02 14:58:47.331140 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.331128 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4dnmg\"" Jul 02 14:58:47.341854 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.341831 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kn77n"] Jul 02 14:58:47.387339 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.387307 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:47.429286 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.429250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx6rj\" (UniqueName: \"kubernetes.io/projected/3959b5ab-1448-423a-b58a-e58cb1fdefc5-kube-api-access-rx6rj\") pod \"odh-model-controller-7998c67dc4-kn77n\" (UID: \"3959b5ab-1448-423a-b58a-e58cb1fdefc5\") " pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:47.429686 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.429291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3959b5ab-1448-423a-b58a-e58cb1fdefc5-cert\") pod \"odh-model-controller-7998c67dc4-kn77n\" (UID: \"3959b5ab-1448-423a-b58a-e58cb1fdefc5\") " pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:47.486984 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.486946 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:47.530566 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.530529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx6rj\" (UniqueName: \"kubernetes.io/projected/3959b5ab-1448-423a-b58a-e58cb1fdefc5-kube-api-access-rx6rj\") pod \"odh-model-controller-7998c67dc4-kn77n\" (UID: \"3959b5ab-1448-423a-b58a-e58cb1fdefc5\") " pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:47.530749 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.530578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3959b5ab-1448-423a-b58a-e58cb1fdefc5-cert\") pod \"odh-model-controller-7998c67dc4-kn77n\" (UID: \"3959b5ab-1448-423a-b58a-e58cb1fdefc5\") " pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:47.530749 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:58:47.530732 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 14:58:47.530833 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:58:47.530814 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3959b5ab-1448-423a-b58a-e58cb1fdefc5-cert podName:3959b5ab-1448-423a-b58a-e58cb1fdefc5 nodeName:}" failed. No retries permitted until 2026-07-02 14:58:48.030793512 +0000 UTC m=+635.367850255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3959b5ab-1448-423a-b58a-e58cb1fdefc5-cert") pod "odh-model-controller-7998c67dc4-kn77n" (UID: "3959b5ab-1448-423a-b58a-e58cb1fdefc5") : secret "odh-model-controller-webhook-cert" not found Jul 02 14:58:47.545407 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.545381 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx6rj\" (UniqueName: \"kubernetes.io/projected/3959b5ab-1448-423a-b58a-e58cb1fdefc5-kube-api-access-rx6rj\") pod \"odh-model-controller-7998c67dc4-kn77n\" (UID: \"3959b5ab-1448-423a-b58a-e58cb1fdefc5\") " pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:47.589702 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.589591 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:47.732623 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.732593 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61932201-db8c-4f90-9476-5e0f752a0b09-tls-certs\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.735761 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.735732 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61932201-db8c-4f90-9476-5e0f752a0b09-tls-certs\") pod \"kube-auth-proxy-685b948f4-nxwnv\" (UID: \"61932201-db8c-4f90-9476-5e0f752a0b09\") " pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:47.785470 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.785438 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:47.983271 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:47.983243 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" Jul 02 14:58:48.034476 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.034442 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3959b5ab-1448-423a-b58a-e58cb1fdefc5-cert\") pod \"odh-model-controller-7998c67dc4-kn77n\" (UID: \"3959b5ab-1448-423a-b58a-e58cb1fdefc5\") " pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:48.037149 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.037121 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3959b5ab-1448-423a-b58a-e58cb1fdefc5-cert\") pod \"odh-model-controller-7998c67dc4-kn77n\" (UID: \"3959b5ab-1448-423a-b58a-e58cb1fdefc5\") " pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:48.150324 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:58:48.150299 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61932201_db8c_4f90_9476_5e0f752a0b09.slice/crio-5d523af2b827be023da35a78e5b2ef9472c0ec3348352db3676cab1fdab2f45a WatchSource:0}: Error finding container 5d523af2b827be023da35a78e5b2ef9472c0ec3348352db3676cab1fdab2f45a: Status 404 returned error can't find the container with id 5d523af2b827be023da35a78e5b2ef9472c0ec3348352db3676cab1fdab2f45a Jul 02 14:58:48.150587 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.150562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-685b948f4-nxwnv"] Jul 02 14:58:48.238533 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.238443 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:48.246691 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.246639 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qctxp"] Jul 02 14:58:48.248814 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.248794 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.264869 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.264838 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 14:58:48.268532 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:58:48.268505 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"model-serving-api-54d89bd5fc-qctxp\" is forbidden: User \"system:node:ip-10-0-128-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-44.ec2.internal' and this object" podUID="03dc3076-8102-4d5f-be3a-3047ceba86c7" pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.309613 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.309584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qctxp"] Jul 02 14:58:48.337203 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.337156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03dc3076-8102-4d5f-be3a-3047ceba86c7-tls-certs\") pod \"model-serving-api-54d89bd5fc-qctxp\" (UID: \"03dc3076-8102-4d5f-be3a-3047ceba86c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.337370 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.337218 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czqvt\" (UniqueName: \"kubernetes.io/projected/03dc3076-8102-4d5f-be3a-3047ceba86c7-kube-api-access-czqvt\") pod \"model-serving-api-54d89bd5fc-qctxp\" (UID: \"03dc3076-8102-4d5f-be3a-3047ceba86c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.373230 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.373202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:48.387664 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.387620 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kn77n"] Jul 02 14:58:48.390441 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:58:48.390421 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3959b5ab_1448_423a_b58a_e58cb1fdefc5.slice/crio-acb84bea1fd05f6400f96f3c0f93b970aff2fc4916ee3240cd26daf3844d935f WatchSource:0}: Error finding container acb84bea1fd05f6400f96f3c0f93b970aff2fc4916ee3240cd26daf3844d935f: Status 404 returned error can't find the container with id acb84bea1fd05f6400f96f3c0f93b970aff2fc4916ee3240cd26daf3844d935f Jul 02 14:58:48.396879 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.396855 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" event={"ID":"3959b5ab-1448-423a-b58a-e58cb1fdefc5","Type":"ContainerStarted","Data":"acb84bea1fd05f6400f96f3c0f93b970aff2fc4916ee3240cd26daf3844d935f"} Jul 02 14:58:48.397911 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.397883 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" event={"ID":"61932201-db8c-4f90-9476-5e0f752a0b09","Type":"ContainerStarted","Data":"5d523af2b827be023da35a78e5b2ef9472c0ec3348352db3676cab1fdab2f45a"} Jul 02 14:58:48.437898 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.437867 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03dc3076-8102-4d5f-be3a-3047ceba86c7-tls-certs\") pod \"model-serving-api-54d89bd5fc-qctxp\" (UID: \"03dc3076-8102-4d5f-be3a-3047ceba86c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.438308 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.437921 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czqvt\" (UniqueName: \"kubernetes.io/projected/03dc3076-8102-4d5f-be3a-3047ceba86c7-kube-api-access-czqvt\") pod \"model-serving-api-54d89bd5fc-qctxp\" (UID: \"03dc3076-8102-4d5f-be3a-3047ceba86c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.440517 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.440492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03dc3076-8102-4d5f-be3a-3047ceba86c7-tls-certs\") pod \"model-serving-api-54d89bd5fc-qctxp\" (UID: \"03dc3076-8102-4d5f-be3a-3047ceba86c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.449461 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.449436 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czqvt\" (UniqueName: \"kubernetes.io/projected/03dc3076-8102-4d5f-be3a-3047ceba86c7-kube-api-access-czqvt\") pod \"model-serving-api-54d89bd5fc-qctxp\" (UID: \"03dc3076-8102-4d5f-be3a-3047ceba86c7\") " pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.479564 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.479526 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:48.567859 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.567765 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:48.703000 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.702968 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qctxp"] Jul 02 14:58:48.704959 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:58:48.704935 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03dc3076_8102_4d5f_be3a_3047ceba86c7.slice/crio-99c45b087a2c520134161c5b20d07a9e6602bb338389766a4ddaf60e0532826f WatchSource:0}: Error finding container 99c45b087a2c520134161c5b20d07a9e6602bb338389766a4ddaf60e0532826f: Status 404 returned error can't find the container with id 99c45b087a2c520134161c5b20d07a9e6602bb338389766a4ddaf60e0532826f Jul 02 14:58:48.743977 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.743942 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:48.759790 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.759761 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p56xc"] Jul 02 14:58:48.762113 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.762097 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.766472 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.766451 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 14:58:48.766694 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.766644 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 14:58:48.766694 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.766671 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dn2z9\"" Jul 02 14:58:48.766842 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.766714 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 14:58:48.766842 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.766673 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 14:58:48.783982 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.783964 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p56xc"] Jul 02 14:58:48.841471 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.841369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.841471 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.841408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-cacerts\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.841471 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.841464 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.841747 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.841515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.841747 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.841546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-token\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.841747 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.841562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e93edb55-c01f-4280-b957-14ecdfe8cde4-local-certs\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.841747 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.841696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wntgj\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-kube-api-access-wntgj\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.861170 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.861125 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:48.942337 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.942295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.942534 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.942342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.942534 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.942380 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-token\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.942642 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.942557 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e93edb55-c01f-4280-b957-14ecdfe8cde4-local-certs\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.942713 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.942678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wntgj\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-kube-api-access-wntgj\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.942775 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.942721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.942775 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.942748 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-cacerts\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.943535 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.943511 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.945055 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.945027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e93edb55-c01f-4280-b957-14ecdfe8cde4-local-certs\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.945416 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.945391 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-cacerts\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.945505 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.945479 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.945756 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.945741 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.951577 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.951552 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wntgj\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-kube-api-access-wntgj\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:48.952386 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:48.952366 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-token\") pod \"istiod-openshift-gateway-7574459656-p56xc\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:49.071206 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:49.071171 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:49.225451 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:49.225364 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p56xc"] Jul 02 14:58:49.231629 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:58:49.231552 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode93edb55_c01f_4280_b957_14ecdfe8cde4.slice/crio-31f743ca85bc42a22c232dc1065df7f4ac577a4bca39d8f50eb00bb1ec4f0a5a WatchSource:0}: Error finding container 31f743ca85bc42a22c232dc1065df7f4ac577a4bca39d8f50eb00bb1ec4f0a5a: Status 404 returned error can't find the container with id 31f743ca85bc42a22c232dc1065df7f4ac577a4bca39d8f50eb00bb1ec4f0a5a Jul 02 14:58:49.404969 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:49.404813 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" event={"ID":"03dc3076-8102-4d5f-be3a-3047ceba86c7","Type":"ContainerStarted","Data":"99c45b087a2c520134161c5b20d07a9e6602bb338389766a4ddaf60e0532826f"} Jul 02 14:58:49.408923 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:49.407914 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" event={"ID":"e93edb55-c01f-4280-b957-14ecdfe8cde4","Type":"ContainerStarted","Data":"31f743ca85bc42a22c232dc1065df7f4ac577a4bca39d8f50eb00bb1ec4f0a5a"} Jul 02 14:58:50.330076 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:50.330038 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:54.113109 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.113066 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 02 14:58:54.113445 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.113159 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 02 14:58:54.431193 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.431096 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" event={"ID":"61932201-db8c-4f90-9476-5e0f752a0b09","Type":"ContainerStarted","Data":"a1d546cc51f5183e650eb71413891def428c375cbd32dedc2808cfd3b331c234"} Jul 02 14:58:54.432745 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.432716 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" event={"ID":"e93edb55-c01f-4280-b957-14ecdfe8cde4","Type":"ContainerStarted","Data":"e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf"} Jul 02 14:58:54.432886 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.432771 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:54.434403 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.434378 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" event={"ID":"3959b5ab-1448-423a-b58a-e58cb1fdefc5","Type":"ContainerStarted","Data":"2cb117742d104402244ba8780c1f3ccaf004047652be32fcb3d8de962caf5d9a"} Jul 02 14:58:54.434543 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.434484 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:58:54.436082 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.436057 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" event={"ID":"03dc3076-8102-4d5f-be3a-3047ceba86c7","Type":"ContainerStarted","Data":"2bd0c210b913f96849323ff971303f3f88447f7d248995d4510321ca8915d3e5"} Jul 02 14:58:54.436197 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.436140 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:58:54.449272 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.449225 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-685b948f4-nxwnv" podStartSLOduration=1.501565762 podStartE2EDuration="7.449209608s" totalImagesPullingTime="5.947643846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:54.448839774 +0000 UTC m=+641.785896539" watchObservedRunningTime="2026-07-02 14:58:54.449209608 +0000 UTC m=+641.786266370" Jul 02 14:58:54.466895 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.466819 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" podStartSLOduration=1.074472323 podStartE2EDuration="6.466799521s" totalImagesPullingTime="5.392327198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:54.466184032 +0000 UTC m=+641.803240796" watchObservedRunningTime="2026-07-02 14:58:54.466799521 +0000 UTC m=+641.803856286" Jul 02 14:58:54.488971 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.488575 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" podStartSLOduration=1.610141434 podStartE2EDuration="6.488557389s" totalImagesPullingTime="4.878415955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:54.488038747 +0000 UTC m=+641.825095511" watchObservedRunningTime="2026-07-02 14:58:54.488557389 +0000 UTC m=+641.825614154" Jul 02 14:58:54.516580 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.516534 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" podStartSLOduration=1.7955346699999999 podStartE2EDuration="7.516520365s" totalImagesPullingTime="5.720985695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:54.515037295 +0000 UTC m=+641.852094060" watchObservedRunningTime="2026-07-02 14:58:54.516520365 +0000 UTC m=+641.853577130" Jul 02 14:58:54.896114 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:54.896075 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:55.068302 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:55.068265 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:55.441928 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:55.441895 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-p56xc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 14:58:55.442284 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:55.441942 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" podUID="e93edb55-c01f-4280-b957-14ecdfe8cde4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 14:58:55.768735 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:55.768704 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:55.982886 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:55.982843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:56.352425 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:56.352384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:57.830424 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.830394 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2"] Jul 02 14:58:57.833742 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.833721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:57.839944 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.839922 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 14:58:57.840028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.839956 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 14:58:57.840028 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.840006 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 14:58:57.840266 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.840245 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:58:57.840401 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.840361 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 14:58:57.840460 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.840452 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tsd52\"" Jul 02 14:58:57.854183 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.854155 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2"] Jul 02 14:58:57.918967 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.918929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49b8d657-0906-4084-8420-a9433131a90a-cert\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:57.919159 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.918998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/49b8d657-0906-4084-8420-a9433131a90a-manager-config\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:57.919159 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.919043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/49b8d657-0906-4084-8420-a9433131a90a-metrics-cert\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:57.919159 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:57.919072 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmcjt\" (UniqueName: \"kubernetes.io/projected/49b8d657-0906-4084-8420-a9433131a90a-kube-api-access-bmcjt\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.019643 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.019603 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49b8d657-0906-4084-8420-a9433131a90a-cert\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.019855 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.019685 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/49b8d657-0906-4084-8420-a9433131a90a-manager-config\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.019855 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.019724 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/49b8d657-0906-4084-8420-a9433131a90a-metrics-cert\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.019855 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.019752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmcjt\" (UniqueName: \"kubernetes.io/projected/49b8d657-0906-4084-8420-a9433131a90a-kube-api-access-bmcjt\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.020476 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.020449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/49b8d657-0906-4084-8420-a9433131a90a-manager-config\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.022596 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.022571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49b8d657-0906-4084-8420-a9433131a90a-cert\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.022767 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.022745 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/49b8d657-0906-4084-8420-a9433131a90a-metrics-cert\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.041262 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.041224 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmcjt\" (UniqueName: \"kubernetes.io/projected/49b8d657-0906-4084-8420-a9433131a90a-kube-api-access-bmcjt\") pod \"lws-controller-manager-5bdfcfdbc4-9j7z2\" (UID: \"49b8d657-0906-4084-8420-a9433131a90a\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.142672 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.142556 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:58:58.317104 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.317080 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2"] Jul 02 14:58:58.319526 ip-10-0-128-44 kubenswrapper[2559]: W0702 14:58:58.319497 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b8d657_0906_4084_8420_a9433131a90a.slice/crio-22f4d8585d8220c586d3540c53d2a6de6f7ae2aac683d3314c351abbbbb3dc76 WatchSource:0}: Error finding container 22f4d8585d8220c586d3540c53d2a6de6f7ae2aac683d3314c351abbbbb3dc76: Status 404 returned error can't find the container with id 22f4d8585d8220c586d3540c53d2a6de6f7ae2aac683d3314c351abbbbb3dc76 Jul 02 14:58:58.441877 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.441796 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:58:58.452386 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.452358 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" event={"ID":"49b8d657-0906-4084-8420-a9433131a90a","Type":"ContainerStarted","Data":"22f4d8585d8220c586d3540c53d2a6de6f7ae2aac683d3314c351abbbbb3dc76"} Jul 02 14:58:58.995286 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:58.995178 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:59.177628 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:59.177559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:59.656183 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:59.656145 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:58:59.837154 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:58:59.837104 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:59:00.354536 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:00.354497 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:59:00.465112 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:00.465072 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:59:00.622506 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:00.622400 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:59:01.468413 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:01.468376 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" event={"ID":"49b8d657-0906-4084-8420-a9433131a90a","Type":"ContainerStarted","Data":"5cc4ce701162e45973b5eaf73a4450093988f2f4346fdc68d8e0e124f4f9fd23"} Jul 02 14:59:01.468785 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:01.468444 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:59:01.490596 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:01.490551 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" podStartSLOduration=2.090102196 podStartE2EDuration="4.490537405s" totalImagesPullingTime="2.400435209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:59:01.489220948 +0000 UTC m=+648.826277717" watchObservedRunningTime="2026-07-02 14:59:01.490537405 +0000 UTC m=+648.827594168" Jul 02 14:59:02.126803 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.126767 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p56xc"] Jul 02 14:59:02.127033 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.127003 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" podUID="e93edb55-c01f-4280-b957-14ecdfe8cde4" containerName="discovery" containerID="cri-o://e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf" gracePeriod=30 Jul 02 14:59:02.365320 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.365290 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:59:02.459246 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.459219 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e93edb55-c01f-4280-b957-14ecdfe8cde4-local-certs\") pod \"e93edb55-c01f-4280-b957-14ecdfe8cde4\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " Jul 02 14:59:02.459396 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.459264 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-dns-cert\") pod \"e93edb55-c01f-4280-b957-14ecdfe8cde4\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " Jul 02 14:59:02.459396 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.459301 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-cacerts\") pod \"e93edb55-c01f-4280-b957-14ecdfe8cde4\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " Jul 02 14:59:02.459396 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.459319 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wntgj\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-kube-api-access-wntgj\") pod \"e93edb55-c01f-4280-b957-14ecdfe8cde4\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " Jul 02 14:59:02.459396 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.459334 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-token\") pod \"e93edb55-c01f-4280-b957-14ecdfe8cde4\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " Jul 02 14:59:02.459396 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.459357 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-ca-configmap\") pod \"e93edb55-c01f-4280-b957-14ecdfe8cde4\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " Jul 02 14:59:02.459396 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.459388 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-kubeconfig\") pod \"e93edb55-c01f-4280-b957-14ecdfe8cde4\" (UID: \"e93edb55-c01f-4280-b957-14ecdfe8cde4\") " Jul 02 14:59:02.459914 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.459874 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e93edb55-c01f-4280-b957-14ecdfe8cde4" (UID: "e93edb55-c01f-4280-b957-14ecdfe8cde4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:59:02.461923 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.461896 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e93edb55-c01f-4280-b957-14ecdfe8cde4" (UID: "e93edb55-c01f-4280-b957-14ecdfe8cde4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:59:02.461923 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.461905 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-token" (OuterVolumeSpecName: "istio-token") pod "e93edb55-c01f-4280-b957-14ecdfe8cde4" (UID: "e93edb55-c01f-4280-b957-14ecdfe8cde4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:59:02.462138 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.462115 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-cacerts" (OuterVolumeSpecName: "cacerts") pod "e93edb55-c01f-4280-b957-14ecdfe8cde4" (UID: "e93edb55-c01f-4280-b957-14ecdfe8cde4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:59:02.462194 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.462181 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e93edb55-c01f-4280-b957-14ecdfe8cde4-local-certs" (OuterVolumeSpecName: "local-certs") pod "e93edb55-c01f-4280-b957-14ecdfe8cde4" (UID: "e93edb55-c01f-4280-b957-14ecdfe8cde4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:59:02.462264 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.462245 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e93edb55-c01f-4280-b957-14ecdfe8cde4" (UID: "e93edb55-c01f-4280-b957-14ecdfe8cde4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:59:02.462395 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.462381 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-kube-api-access-wntgj" (OuterVolumeSpecName: "kube-api-access-wntgj") pod "e93edb55-c01f-4280-b957-14ecdfe8cde4" (UID: "e93edb55-c01f-4280-b957-14ecdfe8cde4"). InnerVolumeSpecName "kube-api-access-wntgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:59:02.473328 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.473302 2559 generic.go:356] "Generic (PLEG): container finished" podID="e93edb55-c01f-4280-b957-14ecdfe8cde4" containerID="e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf" exitCode=0 Jul 02 14:59:02.473738 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.473344 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" Jul 02 14:59:02.473738 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.473379 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" event={"ID":"e93edb55-c01f-4280-b957-14ecdfe8cde4","Type":"ContainerDied","Data":"e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf"} Jul 02 14:59:02.473738 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.473426 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-p56xc" event={"ID":"e93edb55-c01f-4280-b957-14ecdfe8cde4","Type":"ContainerDied","Data":"31f743ca85bc42a22c232dc1065df7f4ac577a4bca39d8f50eb00bb1ec4f0a5a"} Jul 02 14:59:02.473738 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.473445 2559 scope.go:117] "RemoveContainer" containerID="e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf" Jul 02 14:59:02.481938 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.481920 2559 scope.go:117] "RemoveContainer" containerID="e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf" Jul 02 14:59:02.482210 ip-10-0-128-44 kubenswrapper[2559]: E0702 14:59:02.482192 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf\": container with ID starting with e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf not found: ID does not exist" containerID="e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf" Jul 02 14:59:02.482253 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.482219 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf"} err="failed to get container status \"e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf\": rpc error: code = NotFound desc = could not find container \"e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf\": container with ID starting with e0130bafae5f301fafd7d8a70c84e25aec913d113598eab8b47947d7f0c40dcf not found: ID does not exist" Jul 02 14:59:02.499148 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.499119 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p56xc"] Jul 02 14:59:02.500520 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.500501 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-p56xc"] Jul 02 14:59:02.560387 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.560343 2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-cacerts\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:59:02.560387 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.560385 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wntgj\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-kube-api-access-wntgj\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:59:02.560587 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.560398 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-token\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:59:02.560587 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.560412 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-ca-configmap\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:59:02.560587 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.560424 2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-kubeconfig\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:59:02.560587 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.560435 2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e93edb55-c01f-4280-b957-14ecdfe8cde4-local-certs\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:59:02.560587 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:02.560448 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e93edb55-c01f-4280-b957-14ecdfe8cde4-istio-csr-dns-cert\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 14:59:03.157193 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:03.157164 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e93edb55-c01f-4280-b957-14ecdfe8cde4" path="/var/lib/kubelet/pods/e93edb55-c01f-4280-b957-14ecdfe8cde4/volumes" Jul 02 14:59:05.442022 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:05.441989 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kn77n" Jul 02 14:59:05.445289 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:05.445269 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qctxp" Jul 02 14:59:12.475816 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:12.475787 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-9j7z2" Jul 02 14:59:48.020697 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:48.020635 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:59:48.092273 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:48.092239 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:59:48.253803 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:48.253764 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 14:59:50.856412 ip-10-0-128-44 kubenswrapper[2559]: I0702 14:59:50.856375 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:02.402435 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:02.402400 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:02.631584 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:02.631548 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:02.908496 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:02.908459 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:13.631384 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:13.631312 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:13.727101 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:13.727062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:21.215279 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:21.215245 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:24.840202 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:24.840159 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:26.681225 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:26.681179 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:27.096896 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:27.096862 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:27.670036 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:27.670000 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:27.798668 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:27.798623 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:29.672396 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:29.672359 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:31.742168 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:31.742132 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:31.920909 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:31.920868 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:34.266874 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:34.266834 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:36.004165 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:36.004124 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:36.081855 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:36.081816 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:37.393951 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.393910 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd"] Jul 02 15:00:37.394402 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.394284 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e93edb55-c01f-4280-b957-14ecdfe8cde4" containerName="discovery" Jul 02 15:00:37.394402 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.394301 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e93edb55-c01f-4280-b957-14ecdfe8cde4" containerName="discovery" Jul 02 15:00:37.394402 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.394381 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e93edb55-c01f-4280-b957-14ecdfe8cde4" containerName="discovery" Jul 02 15:00:37.396084 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.396065 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.399280 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.399258 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 15:00:37.399280 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.399275 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 15:00:37.399463 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.399305 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zkdgw\"" Jul 02 15:00:37.399463 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.399309 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 02 15:00:37.399463 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.399306 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 02 15:00:37.405231 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.405209 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd"] Jul 02 15:00:37.437307 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.437280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.437462 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.437331 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.437462 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.437390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmsfp\" (UniqueName: \"kubernetes.io/projected/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-kube-api-access-tmsfp\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.438801 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.438779 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:37.538000 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.537970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.538134 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.538016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.538134 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.538056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmsfp\" (UniqueName: \"kubernetes.io/projected/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-kube-api-access-tmsfp\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.538699 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.538683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.540414 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.540390 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.542158 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.542134 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:37.547470 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.547441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmsfp\" (UniqueName: \"kubernetes.io/projected/2d3edd8d-ae90-4df7-82b0-1777dd83ebac-kube-api-access-tmsfp\") pod \"kuadrant-console-plugin-66b5774985-wfsjd\" (UID: \"2d3edd8d-ae90-4df7-82b0-1777dd83ebac\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.705590 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.705516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" Jul 02 15:00:37.828828 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:37.828805 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd"] Jul 02 15:00:37.830773 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:00:37.830752 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d3edd8d_ae90_4df7_82b0_1777dd83ebac.slice/crio-f8877b88645cda3c2814533469d595663b2fe48c073e84e0b6f2488f07e05222 WatchSource:0}: Error finding container f8877b88645cda3c2814533469d595663b2fe48c073e84e0b6f2488f07e05222: Status 404 returned error can't find the container with id f8877b88645cda3c2814533469d595663b2fe48c073e84e0b6f2488f07e05222 Jul 02 15:00:38.819547 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:38.819510 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" event={"ID":"2d3edd8d-ae90-4df7-82b0-1777dd83ebac","Type":"ContainerStarted","Data":"f8877b88645cda3c2814533469d595663b2fe48c073e84e0b6f2488f07e05222"} Jul 02 15:00:45.223502 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:45.223458 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:45.324310 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:45.324275 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:47.717492 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:47.717397 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:47.818420 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:47.818389 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:52.469817 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:52.469776 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:52.574497 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:52.574465 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:56.413202 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:56.413170 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:00:56.478513 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:00:56.478476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:03.922282 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:03.922229 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" event={"ID":"2d3edd8d-ae90-4df7-82b0-1777dd83ebac","Type":"ContainerStarted","Data":"f1ecf540d87c9ff56d7e44c8252ae4ed6966266120de8f6c1753a166e0adbc03"} Jul 02 15:01:03.952243 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:03.952199 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-wfsjd" podStartSLOduration=1.73444427 podStartE2EDuration="26.952185051s" totalImagesPullingTime="25.217740781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:01:03.950708675 +0000 UTC m=+771.287765440" watchObservedRunningTime="2026-07-02 15:01:03.952185051 +0000 UTC m=+771.289241815" Jul 02 15:01:04.886666 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:04.886611 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:04.986429 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:04.986387 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:07.379566 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:07.379533 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:07.519806 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:07.519769 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:12.078096 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:12.078060 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:12.178204 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:12.178171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:16.173373 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:16.173325 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:16.305599 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:16.305559 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:22.202157 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:22.202113 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:22.296129 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:22.296092 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:25.302820 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:25.302777 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:25.370093 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:25.370064 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:27.751176 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:27.751141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:27.808069 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:27.808035 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:28.330327 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:28.330289 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:28.429243 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:28.429211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:28.531130 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:28.531098 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:28.904773 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:28.904742 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:29.005821 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.005790 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:29.128113 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.128080 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wwt2d"] Jul 02 15:01:29.192692 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.192578 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:29.292758 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.292724 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:29.732298 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.732259 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wwt2d" Jul 02 15:01:29.736171 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.736149 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fznhg\"" Jul 02 15:01:29.737540 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.737519 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wwt2d"] Jul 02 15:01:29.737685 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.737555 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-jlwz4"] Jul 02 15:01:29.738602 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.738580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbgzv\" (UniqueName: \"kubernetes.io/projected/dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c-kube-api-access-vbgzv\") pod \"authorino-58cd955675-wwt2d\" (UID: \"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c\") " pod="kuadrant-system/authorino-58cd955675-wwt2d" Jul 02 15:01:29.839357 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.839323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbgzv\" (UniqueName: \"kubernetes.io/projected/dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c-kube-api-access-vbgzv\") pod \"authorino-58cd955675-wwt2d\" (UID: \"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c\") " pod="kuadrant-system/authorino-58cd955675-wwt2d" Jul 02 15:01:29.849233 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.849197 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbgzv\" (UniqueName: \"kubernetes.io/projected/dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c-kube-api-access-vbgzv\") pod \"authorino-58cd955675-wwt2d\" (UID: \"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c\") " pod="kuadrant-system/authorino-58cd955675-wwt2d" Jul 02 15:01:29.996151 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.996070 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jlwz4"] Jul 02 15:01:29.996498 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:29.996193 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jlwz4" Jul 02 15:01:30.041083 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:30.041055 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wwt2d" Jul 02 15:01:30.041237 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:30.041219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsp2j\" (UniqueName: \"kubernetes.io/projected/82a29d47-a9e1-4997-8ea3-6e5e2685b0c3-kube-api-access-xsp2j\") pod \"authorino-75d556bd77-jlwz4\" (UID: \"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3\") " pod="kuadrant-system/authorino-75d556bd77-jlwz4" Jul 02 15:01:30.142302 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:30.142260 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsp2j\" (UniqueName: \"kubernetes.io/projected/82a29d47-a9e1-4997-8ea3-6e5e2685b0c3-kube-api-access-xsp2j\") pod \"authorino-75d556bd77-jlwz4\" (UID: \"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3\") " pod="kuadrant-system/authorino-75d556bd77-jlwz4" Jul 02 15:01:30.151215 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:30.151188 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsp2j\" (UniqueName: \"kubernetes.io/projected/82a29d47-a9e1-4997-8ea3-6e5e2685b0c3-kube-api-access-xsp2j\") pod \"authorino-75d556bd77-jlwz4\" (UID: \"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3\") " pod="kuadrant-system/authorino-75d556bd77-jlwz4" Jul 02 15:01:30.225140 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:30.225113 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wwt2d"] Jul 02 15:01:30.227780 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:01:30.227748 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd7cd4a7_bb17_4b0c_a2ac_3d648500d29c.slice/crio-27de3e52b882a5b968c4b4e3ee58372e6103b0f17ebbce4bf95ee7a1ce7d7f67 WatchSource:0}: Error finding container 27de3e52b882a5b968c4b4e3ee58372e6103b0f17ebbce4bf95ee7a1ce7d7f67: Status 404 returned error can't find the container with id 27de3e52b882a5b968c4b4e3ee58372e6103b0f17ebbce4bf95ee7a1ce7d7f67 Jul 02 15:01:30.305672 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:30.305581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jlwz4" Jul 02 15:01:30.447790 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:30.447764 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jlwz4"] Jul 02 15:01:30.450236 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:01:30.450211 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82a29d47_a9e1_4997_8ea3_6e5e2685b0c3.slice/crio-cd1cc1355739c38e1c7985eb2df027d371a6d0e09aad733de918031a95a3b3ae WatchSource:0}: Error finding container cd1cc1355739c38e1c7985eb2df027d371a6d0e09aad733de918031a95a3b3ae: Status 404 returned error can't find the container with id cd1cc1355739c38e1c7985eb2df027d371a6d0e09aad733de918031a95a3b3ae Jul 02 15:01:31.016991 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:31.016957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wwt2d" event={"ID":"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c","Type":"ContainerStarted","Data":"27de3e52b882a5b968c4b4e3ee58372e6103b0f17ebbce4bf95ee7a1ce7d7f67"} Jul 02 15:01:31.018089 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:31.018063 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jlwz4" event={"ID":"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3","Type":"ContainerStarted","Data":"cd1cc1355739c38e1c7985eb2df027d371a6d0e09aad733de918031a95a3b3ae"} Jul 02 15:01:32.488474 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:32.488437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:32.625064 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:32.624921 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:35.041737 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:35.041698 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wwt2d" event={"ID":"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c","Type":"ContainerStarted","Data":"f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c"} Jul 02 15:01:35.043105 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:35.043081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jlwz4" event={"ID":"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3","Type":"ContainerStarted","Data":"06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1"} Jul 02 15:01:35.059105 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:35.059061 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wwt2d" podStartSLOduration=2.219521999 podStartE2EDuration="6.059048481s" totalImagesPullingTime="3.839526482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:01:35.058705665 +0000 UTC m=+802.395762430" watchObservedRunningTime="2026-07-02 15:01:35.059048481 +0000 UTC m=+802.396105244" Jul 02 15:01:35.077175 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:35.077118 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-jlwz4" podStartSLOduration=2.46825667 podStartE2EDuration="6.077096084s" totalImagesPullingTime="3.608839414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:01:35.076893076 +0000 UTC m=+802.413949842" watchObservedRunningTime="2026-07-02 15:01:35.077096084 +0000 UTC m=+802.414152849" Jul 02 15:01:35.106727 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:35.106691 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wwt2d"] Jul 02 15:01:37.050839 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:37.050793 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wwt2d" podUID="dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c" containerName="authorino" containerID="cri-o://f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c" gracePeriod=30 Jul 02 15:01:37.291929 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:37.291905 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wwt2d" Jul 02 15:01:37.405798 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:37.405710 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbgzv\" (UniqueName: \"kubernetes.io/projected/dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c-kube-api-access-vbgzv\") pod \"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c\" (UID: \"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c\") " Jul 02 15:01:37.407994 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:37.407962 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c-kube-api-access-vbgzv" (OuterVolumeSpecName: "kube-api-access-vbgzv") pod "dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c" (UID: "dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c"). InnerVolumeSpecName "kube-api-access-vbgzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:01:37.507024 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:37.506995 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbgzv\" (UniqueName: \"kubernetes.io/projected/dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c-kube-api-access-vbgzv\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:01:38.055967 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.055931 2559 generic.go:356] "Generic (PLEG): container finished" podID="dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c" containerID="f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c" exitCode=0 Jul 02 15:01:38.056384 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.055977 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wwt2d" Jul 02 15:01:38.056384 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.056021 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wwt2d" event={"ID":"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c","Type":"ContainerDied","Data":"f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c"} Jul 02 15:01:38.056384 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.056064 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wwt2d" event={"ID":"dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c","Type":"ContainerDied","Data":"27de3e52b882a5b968c4b4e3ee58372e6103b0f17ebbce4bf95ee7a1ce7d7f67"} Jul 02 15:01:38.056384 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.056082 2559 scope.go:117] "RemoveContainer" containerID="f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c" Jul 02 15:01:38.064439 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.064424 2559 scope.go:117] "RemoveContainer" containerID="f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c" Jul 02 15:01:38.064697 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:01:38.064679 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c\": container with ID starting with f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c not found: ID does not exist" containerID="f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c" Jul 02 15:01:38.064753 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.064708 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c"} err="failed to get container status \"f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c\": rpc error: code = NotFound desc = could not find container \"f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c\": container with ID starting with f1abcf895f9b3927b0d5a62bfbf715dd28fb3d71263aab9223518e7f2999937c not found: ID does not exist" Jul 02 15:01:38.078044 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.078017 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wwt2d"] Jul 02 15:01:38.083531 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:38.083512 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wwt2d"] Jul 02 15:01:39.157539 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:39.157504 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c" path="/var/lib/kubelet/pods/dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c/volumes" Jul 02 15:01:45.017251 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:45.017221 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:57.697216 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:57.697171 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:57.855268 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:57.855227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:01:57.983137 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:01:57.983104 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:02:23.289180 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.289137 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:02:23.390706 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.390640 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:02:23.675846 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.675772 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:02:23.676038 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.676026 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c" containerName="authorino" Jul 02 15:02:23.676087 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.676039 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c" containerName="authorino" Jul 02 15:02:23.676123 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.676096 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd7cd4a7-bb17-4b0c-a2ac-3d648500d29c" containerName="authorino" Jul 02 15:02:23.678727 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.678711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:23.681795 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.681772 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fckmt\"" Jul 02 15:02:23.681928 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.681796 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 15:02:23.681928 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.681808 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 15:02:23.683238 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.683217 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 15:02:23.687608 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.687586 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:02:23.851881 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.851842 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p75q6\" (UniqueName: \"kubernetes.io/projected/62bac272-88f8-4e36-b6a9-d98114034fc2-kube-api-access-p75q6\") pod \"maas-keycloak-0\" (UID: \"62bac272-88f8-4e36-b6a9-d98114034fc2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:23.952846 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.952755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p75q6\" (UniqueName: \"kubernetes.io/projected/62bac272-88f8-4e36-b6a9-d98114034fc2-kube-api-access-p75q6\") pod \"maas-keycloak-0\" (UID: \"62bac272-88f8-4e36-b6a9-d98114034fc2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:23.962008 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.961986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p75q6\" (UniqueName: \"kubernetes.io/projected/62bac272-88f8-4e36-b6a9-d98114034fc2-kube-api-access-p75q6\") pod \"maas-keycloak-0\" (UID: \"62bac272-88f8-4e36-b6a9-d98114034fc2\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:23.988546 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:23.988521 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:24.116900 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:24.116870 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:02:24.120456 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:02:24.120430 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bac272_88f8_4e36_b6a9_d98114034fc2.slice/crio-fceb3847be8fafd08a966b054340129413cdd6e26f80d7b8557b6ebf9f6aa9b9 WatchSource:0}: Error finding container fceb3847be8fafd08a966b054340129413cdd6e26f80d7b8557b6ebf9f6aa9b9: Status 404 returned error can't find the container with id fceb3847be8fafd08a966b054340129413cdd6e26f80d7b8557b6ebf9f6aa9b9 Jul 02 15:02:24.233057 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:24.233024 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"62bac272-88f8-4e36-b6a9-d98114034fc2","Type":"ContainerStarted","Data":"fceb3847be8fafd08a966b054340129413cdd6e26f80d7b8557b6ebf9f6aa9b9"} Jul 02 15:02:31.265846 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:31.265811 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"62bac272-88f8-4e36-b6a9-d98114034fc2","Type":"ContainerStarted","Data":"0377c80b13a9ff0c98ba4827fe1134b84bcf4a9ab68697d7ed6b0fc4cb3f8398"} Jul 02 15:02:31.288172 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:31.288050 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.377108515 podStartE2EDuration="8.288027621s" totalImagesPullingTime="6.910919106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:02:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:02:31.284563848 +0000 UTC m=+858.621620613" watchObservedRunningTime="2026-07-02 15:02:31.288027621 +0000 UTC m=+858.625084386" Jul 02 15:02:31.989302 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:31.989257 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:31.990859 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:31.990829 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:32.989046 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:32.988984 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:33.989077 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:33.989038 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:33.989534 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:33.989341 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:34.989450 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:34.989406 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:35.989917 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:35.989861 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:36.989091 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:36.989033 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:37.989519 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:37.989471 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:38.989586 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:38.989530 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:39.989890 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:39.989834 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:40.989287 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:40.989236 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:41.990045 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:41.989989 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:42.989065 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:42.989025 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.23:9000/health/started\": dial tcp 10.132.0.23:9000: connect: connection refused" Jul 02 15:02:44.111898 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:44.111803 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:44.132298 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:44.132261 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:02:54.118288 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:54.118249 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 15:02:54.787946 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:54.787906 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:02:55.027908 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.027872 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h62vk"] Jul 02 15:02:55.035171 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.035150 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h62vk" Jul 02 15:02:55.040484 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.040424 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h62vk"] Jul 02 15:02:55.101668 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.101625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf7n8\" (UniqueName: \"kubernetes.io/projected/4887d6a0-d1af-41e8-85ee-0dd15823d8a2-kube-api-access-pf7n8\") pod \"authorino-5d4b67c446-h62vk\" (UID: \"4887d6a0-d1af-41e8-85ee-0dd15823d8a2\") " pod="kuadrant-system/authorino-5d4b67c446-h62vk" Jul 02 15:02:55.202066 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.202026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf7n8\" (UniqueName: \"kubernetes.io/projected/4887d6a0-d1af-41e8-85ee-0dd15823d8a2-kube-api-access-pf7n8\") pod \"authorino-5d4b67c446-h62vk\" (UID: \"4887d6a0-d1af-41e8-85ee-0dd15823d8a2\") " pod="kuadrant-system/authorino-5d4b67c446-h62vk" Jul 02 15:02:55.202499 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.202172 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:02:55.221350 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.221315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf7n8\" (UniqueName: \"kubernetes.io/projected/4887d6a0-d1af-41e8-85ee-0dd15823d8a2-kube-api-access-pf7n8\") pod \"authorino-5d4b67c446-h62vk\" (UID: \"4887d6a0-d1af-41e8-85ee-0dd15823d8a2\") " pod="kuadrant-system/authorino-5d4b67c446-h62vk" Jul 02 15:02:55.342284 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.342187 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h62vk"] Jul 02 15:02:55.342507 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.342476 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h62vk" Jul 02 15:02:55.375682 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.375640 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-867f65748-zxqm9"] Jul 02 15:02:55.377731 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.377713 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867f65748-zxqm9" Jul 02 15:02:55.392012 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.391985 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-867f65748-zxqm9"] Jul 02 15:02:55.404377 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.404341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9vn4\" (UniqueName: \"kubernetes.io/projected/12dc2242-bbac-4ea2-b085-65589e047c0b-kube-api-access-b9vn4\") pod \"authorino-867f65748-zxqm9\" (UID: \"12dc2242-bbac-4ea2-b085-65589e047c0b\") " pod="kuadrant-system/authorino-867f65748-zxqm9" Jul 02 15:02:55.473520 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.473439 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h62vk"] Jul 02 15:02:55.475411 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:02:55.475388 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4887d6a0_d1af_41e8_85ee_0dd15823d8a2.slice/crio-ba0d2fea03beffc6ed463dea0ff9b332b0a6159fcd925c4bdcbaa4108f5739ee WatchSource:0}: Error finding container ba0d2fea03beffc6ed463dea0ff9b332b0a6159fcd925c4bdcbaa4108f5739ee: Status 404 returned error can't find the container with id ba0d2fea03beffc6ed463dea0ff9b332b0a6159fcd925c4bdcbaa4108f5739ee Jul 02 15:02:55.505361 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.505325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9vn4\" (UniqueName: \"kubernetes.io/projected/12dc2242-bbac-4ea2-b085-65589e047c0b-kube-api-access-b9vn4\") pod \"authorino-867f65748-zxqm9\" (UID: \"12dc2242-bbac-4ea2-b085-65589e047c0b\") " pod="kuadrant-system/authorino-867f65748-zxqm9" Jul 02 15:02:55.514688 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.514640 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9vn4\" (UniqueName: \"kubernetes.io/projected/12dc2242-bbac-4ea2-b085-65589e047c0b-kube-api-access-b9vn4\") pod \"authorino-867f65748-zxqm9\" (UID: \"12dc2242-bbac-4ea2-b085-65589e047c0b\") " pod="kuadrant-system/authorino-867f65748-zxqm9" Jul 02 15:02:55.560985 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.560947 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867f65748-zxqm9"] Jul 02 15:02:55.561200 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.561187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867f65748-zxqm9" Jul 02 15:02:55.588490 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.588461 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c55765c56-7brtl"] Jul 02 15:02:55.590634 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.590614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:02:55.593803 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.593741 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 15:02:55.599249 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.599227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c55765c56-7brtl"] Jul 02 15:02:55.690508 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.690484 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867f65748-zxqm9"] Jul 02 15:02:55.693062 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:02:55.693036 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12dc2242_bbac_4ea2_b085_65589e047c0b.slice/crio-393a369a2c182f82a391ab431af136c2dcd259ccfadb18630696b99e2c88e6b7 WatchSource:0}: Error finding container 393a369a2c182f82a391ab431af136c2dcd259ccfadb18630696b99e2c88e6b7: Status 404 returned error can't find the container with id 393a369a2c182f82a391ab431af136c2dcd259ccfadb18630696b99e2c88e6b7 Jul 02 15:02:55.706758 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.706731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb9dv\" (UniqueName: \"kubernetes.io/projected/41bc094e-7177-4fc3-9764-b6ed70eec762-kube-api-access-zb9dv\") pod \"authorino-6c55765c56-7brtl\" (UID: \"41bc094e-7177-4fc3-9764-b6ed70eec762\") " pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:02:55.706885 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.706769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41bc094e-7177-4fc3-9764-b6ed70eec762-tls-cert\") pod \"authorino-6c55765c56-7brtl\" (UID: \"41bc094e-7177-4fc3-9764-b6ed70eec762\") " pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:02:55.807486 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.807444 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb9dv\" (UniqueName: \"kubernetes.io/projected/41bc094e-7177-4fc3-9764-b6ed70eec762-kube-api-access-zb9dv\") pod \"authorino-6c55765c56-7brtl\" (UID: \"41bc094e-7177-4fc3-9764-b6ed70eec762\") " pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:02:55.807713 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.807499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41bc094e-7177-4fc3-9764-b6ed70eec762-tls-cert\") pod \"authorino-6c55765c56-7brtl\" (UID: \"41bc094e-7177-4fc3-9764-b6ed70eec762\") " pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:02:55.810018 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.809994 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41bc094e-7177-4fc3-9764-b6ed70eec762-tls-cert\") pod \"authorino-6c55765c56-7brtl\" (UID: \"41bc094e-7177-4fc3-9764-b6ed70eec762\") " pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:02:55.816783 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.816763 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb9dv\" (UniqueName: \"kubernetes.io/projected/41bc094e-7177-4fc3-9764-b6ed70eec762-kube-api-access-zb9dv\") pod \"authorino-6c55765c56-7brtl\" (UID: \"41bc094e-7177-4fc3-9764-b6ed70eec762\") " pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:02:55.902587 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:55.902566 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:02:56.051251 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.051226 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c55765c56-7brtl"] Jul 02 15:02:56.052944 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:02:56.052914 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41bc094e_7177_4fc3_9764_b6ed70eec762.slice/crio-2ae3f0a071be6980c8c00f8b284ffc9bd51d8ad9df1f6a2d17943a48c605715c WatchSource:0}: Error finding container 2ae3f0a071be6980c8c00f8b284ffc9bd51d8ad9df1f6a2d17943a48c605715c: Status 404 returned error can't find the container with id 2ae3f0a071be6980c8c00f8b284ffc9bd51d8ad9df1f6a2d17943a48c605715c Jul 02 15:02:56.394334 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.394299 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c55765c56-7brtl" event={"ID":"41bc094e-7177-4fc3-9764-b6ed70eec762","Type":"ContainerStarted","Data":"2ae3f0a071be6980c8c00f8b284ffc9bd51d8ad9df1f6a2d17943a48c605715c"} Jul 02 15:02:56.395353 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.395322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867f65748-zxqm9" event={"ID":"12dc2242-bbac-4ea2-b085-65589e047c0b","Type":"ContainerStarted","Data":"393a369a2c182f82a391ab431af136c2dcd259ccfadb18630696b99e2c88e6b7"} Jul 02 15:02:56.396501 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.396483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h62vk" event={"ID":"4887d6a0-d1af-41e8-85ee-0dd15823d8a2","Type":"ContainerStarted","Data":"befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207"} Jul 02 15:02:56.396599 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.396509 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h62vk" event={"ID":"4887d6a0-d1af-41e8-85ee-0dd15823d8a2","Type":"ContainerStarted","Data":"ba0d2fea03beffc6ed463dea0ff9b332b0a6159fcd925c4bdcbaa4108f5739ee"} Jul 02 15:02:56.396665 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.396606 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-h62vk" podUID="4887d6a0-d1af-41e8-85ee-0dd15823d8a2" containerName="authorino" containerID="cri-o://befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207" gracePeriod=30 Jul 02 15:02:56.411986 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.411934 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-h62vk" podStartSLOduration=1.030551586 podStartE2EDuration="1.411914251s" totalImagesPullingTime="381.362665ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:02:56.410608572 +0000 UTC m=+883.747665337" watchObservedRunningTime="2026-07-02 15:02:56.411914251 +0000 UTC m=+883.748971015" Jul 02 15:02:56.658948 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.658916 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h62vk" Jul 02 15:02:56.715813 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.715780 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf7n8\" (UniqueName: \"kubernetes.io/projected/4887d6a0-d1af-41e8-85ee-0dd15823d8a2-kube-api-access-pf7n8\") pod \"4887d6a0-d1af-41e8-85ee-0dd15823d8a2\" (UID: \"4887d6a0-d1af-41e8-85ee-0dd15823d8a2\") " Jul 02 15:02:56.718087 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.718052 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4887d6a0-d1af-41e8-85ee-0dd15823d8a2-kube-api-access-pf7n8" (OuterVolumeSpecName: "kube-api-access-pf7n8") pod "4887d6a0-d1af-41e8-85ee-0dd15823d8a2" (UID: "4887d6a0-d1af-41e8-85ee-0dd15823d8a2"). InnerVolumeSpecName "kube-api-access-pf7n8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:02:56.816629 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:56.816586 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf7n8\" (UniqueName: \"kubernetes.io/projected/4887d6a0-d1af-41e8-85ee-0dd15823d8a2-kube-api-access-pf7n8\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:02:57.401605 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.401575 2559 generic.go:356] "Generic (PLEG): container finished" podID="4887d6a0-d1af-41e8-85ee-0dd15823d8a2" containerID="befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207" exitCode=0 Jul 02 15:02:57.402078 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.401617 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h62vk" Jul 02 15:02:57.402078 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.401695 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h62vk" event={"ID":"4887d6a0-d1af-41e8-85ee-0dd15823d8a2","Type":"ContainerDied","Data":"befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207"} Jul 02 15:02:57.402078 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.401731 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h62vk" event={"ID":"4887d6a0-d1af-41e8-85ee-0dd15823d8a2","Type":"ContainerDied","Data":"ba0d2fea03beffc6ed463dea0ff9b332b0a6159fcd925c4bdcbaa4108f5739ee"} Jul 02 15:02:57.402078 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.401751 2559 scope.go:117] "RemoveContainer" containerID="befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207" Jul 02 15:02:57.403388 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.403361 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c55765c56-7brtl" event={"ID":"41bc094e-7177-4fc3-9764-b6ed70eec762","Type":"ContainerStarted","Data":"1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b"} Jul 02 15:02:57.405089 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.405065 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867f65748-zxqm9" event={"ID":"12dc2242-bbac-4ea2-b085-65589e047c0b","Type":"ContainerStarted","Data":"c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d"} Jul 02 15:02:57.405206 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.405096 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-867f65748-zxqm9" podUID="12dc2242-bbac-4ea2-b085-65589e047c0b" containerName="authorino" containerID="cri-o://c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d" gracePeriod=30 Jul 02 15:02:57.410516 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.410498 2559 scope.go:117] "RemoveContainer" containerID="befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207" Jul 02 15:02:57.410807 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:02:57.410778 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207\": container with ID starting with befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207 not found: ID does not exist" containerID="befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207" Jul 02 15:02:57.410912 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.410820 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207"} err="failed to get container status \"befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207\": rpc error: code = NotFound desc = could not find container \"befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207\": container with ID starting with befb4f8a3d2dda9ff914ab12cd221d7138aa28f25d2ab49973925ac2816d4207 not found: ID does not exist" Jul 02 15:02:57.422058 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.422014 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-867f65748-zxqm9" podStartSLOduration=1.475501852 podStartE2EDuration="2.421999628s" totalImagesPullingTime="946.497776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:02:57.421497587 +0000 UTC m=+884.758554351" watchObservedRunningTime="2026-07-02 15:02:57.421999628 +0000 UTC m=+884.759056772" Jul 02 15:02:57.434241 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.434218 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h62vk"] Jul 02 15:02:57.437784 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.437764 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h62vk"] Jul 02 15:02:57.452358 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.452319 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c55765c56-7brtl" podStartSLOduration=2.091588284 podStartE2EDuration="2.452295158s" totalImagesPullingTime="360.706874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:02:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:02:57.451294424 +0000 UTC m=+884.788351188" watchObservedRunningTime="2026-07-02 15:02:57.452295158 +0000 UTC m=+884.789351933" Jul 02 15:02:57.475274 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.475242 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jlwz4"] Jul 02 15:02:57.475479 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.475454 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-jlwz4" podUID="82a29d47-a9e1-4997-8ea3-6e5e2685b0c3" containerName="authorino" containerID="cri-o://06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1" gracePeriod=30 Jul 02 15:02:57.717335 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.717313 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867f65748-zxqm9" Jul 02 15:02:57.725190 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.725167 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jlwz4" Jul 02 15:02:57.825048 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.825013 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9vn4\" (UniqueName: \"kubernetes.io/projected/12dc2242-bbac-4ea2-b085-65589e047c0b-kube-api-access-b9vn4\") pod \"12dc2242-bbac-4ea2-b085-65589e047c0b\" (UID: \"12dc2242-bbac-4ea2-b085-65589e047c0b\") " Jul 02 15:02:57.825231 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.825077 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsp2j\" (UniqueName: \"kubernetes.io/projected/82a29d47-a9e1-4997-8ea3-6e5e2685b0c3-kube-api-access-xsp2j\") pod \"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3\" (UID: \"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3\") " Jul 02 15:02:57.827277 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.827252 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12dc2242-bbac-4ea2-b085-65589e047c0b-kube-api-access-b9vn4" (OuterVolumeSpecName: "kube-api-access-b9vn4") pod "12dc2242-bbac-4ea2-b085-65589e047c0b" (UID: "12dc2242-bbac-4ea2-b085-65589e047c0b"). InnerVolumeSpecName "kube-api-access-b9vn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:02:57.827366 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.827275 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a29d47-a9e1-4997-8ea3-6e5e2685b0c3-kube-api-access-xsp2j" (OuterVolumeSpecName: "kube-api-access-xsp2j") pod "82a29d47-a9e1-4997-8ea3-6e5e2685b0c3" (UID: "82a29d47-a9e1-4997-8ea3-6e5e2685b0c3"). InnerVolumeSpecName "kube-api-access-xsp2j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:02:57.926196 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.926161 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsp2j\" (UniqueName: \"kubernetes.io/projected/82a29d47-a9e1-4997-8ea3-6e5e2685b0c3-kube-api-access-xsp2j\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:02:57.926196 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:57.926188 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9vn4\" (UniqueName: \"kubernetes.io/projected/12dc2242-bbac-4ea2-b085-65589e047c0b-kube-api-access-b9vn4\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:02:58.410827 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.410736 2559 generic.go:356] "Generic (PLEG): container finished" podID="82a29d47-a9e1-4997-8ea3-6e5e2685b0c3" containerID="06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1" exitCode=0 Jul 02 15:02:58.410827 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.410778 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-jlwz4" Jul 02 15:02:58.411285 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.410832 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jlwz4" event={"ID":"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3","Type":"ContainerDied","Data":"06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1"} Jul 02 15:02:58.411285 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.410868 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-jlwz4" event={"ID":"82a29d47-a9e1-4997-8ea3-6e5e2685b0c3","Type":"ContainerDied","Data":"cd1cc1355739c38e1c7985eb2df027d371a6d0e09aad733de918031a95a3b3ae"} Jul 02 15:02:58.411285 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.410887 2559 scope.go:117] "RemoveContainer" containerID="06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1" Jul 02 15:02:58.413005 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.412976 2559 generic.go:356] "Generic (PLEG): container finished" podID="12dc2242-bbac-4ea2-b085-65589e047c0b" containerID="c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d" exitCode=0 Jul 02 15:02:58.413123 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.413010 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-867f65748-zxqm9" Jul 02 15:02:58.413123 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.413057 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867f65748-zxqm9" event={"ID":"12dc2242-bbac-4ea2-b085-65589e047c0b","Type":"ContainerDied","Data":"c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d"} Jul 02 15:02:58.413123 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.413094 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-867f65748-zxqm9" event={"ID":"12dc2242-bbac-4ea2-b085-65589e047c0b","Type":"ContainerDied","Data":"393a369a2c182f82a391ab431af136c2dcd259ccfadb18630696b99e2c88e6b7"} Jul 02 15:02:58.419396 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.419378 2559 scope.go:117] "RemoveContainer" containerID="06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1" Jul 02 15:02:58.419684 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:02:58.419666 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1\": container with ID starting with 06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1 not found: ID does not exist" containerID="06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1" Jul 02 15:02:58.419769 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.419692 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1"} err="failed to get container status \"06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1\": rpc error: code = NotFound desc = could not find container \"06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1\": container with ID starting with 06acb4ca07c29d2189ec6554fa3a00e671f76d30ff6e9c8f0a73fd242ddcc2e1 not found: ID does not exist" Jul 02 15:02:58.419769 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.419709 2559 scope.go:117] "RemoveContainer" containerID="c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d" Jul 02 15:02:58.427103 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.427088 2559 scope.go:117] "RemoveContainer" containerID="c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d" Jul 02 15:02:58.427314 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:02:58.427297 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d\": container with ID starting with c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d not found: ID does not exist" containerID="c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d" Jul 02 15:02:58.427355 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.427322 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d"} err="failed to get container status \"c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d\": rpc error: code = NotFound desc = could not find container \"c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d\": container with ID starting with c97fc8d6905ab79d9b8e3977407b999c853cccd09ad4bd72871abb9a7d36cb3d not found: ID does not exist" Jul 02 15:02:58.434325 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.434295 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jlwz4"] Jul 02 15:02:58.438433 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.438408 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-jlwz4"] Jul 02 15:02:58.448973 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.448950 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-867f65748-zxqm9"] Jul 02 15:02:58.452109 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:58.452092 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-867f65748-zxqm9"] Jul 02 15:02:59.158447 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:59.158412 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12dc2242-bbac-4ea2-b085-65589e047c0b" path="/var/lib/kubelet/pods/12dc2242-bbac-4ea2-b085-65589e047c0b/volumes" Jul 02 15:02:59.158722 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:59.158709 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4887d6a0-d1af-41e8-85ee-0dd15823d8a2" path="/var/lib/kubelet/pods/4887d6a0-d1af-41e8-85ee-0dd15823d8a2/volumes" Jul 02 15:02:59.158977 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:02:59.158964 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a29d47-a9e1-4997-8ea3-6e5e2685b0c3" path="/var/lib/kubelet/pods/82a29d47-a9e1-4997-8ea3-6e5e2685b0c3/volumes" Jul 02 15:03:01.857028 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.856997 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ff55dd5d9-vfk8h"] Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857274 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4887d6a0-d1af-41e8-85ee-0dd15823d8a2" containerName="authorino" Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857286 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4887d6a0-d1af-41e8-85ee-0dd15823d8a2" containerName="authorino" Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857294 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12dc2242-bbac-4ea2-b085-65589e047c0b" containerName="authorino" Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857301 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="12dc2242-bbac-4ea2-b085-65589e047c0b" containerName="authorino" Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857317 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a29d47-a9e1-4997-8ea3-6e5e2685b0c3" containerName="authorino" Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857322 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a29d47-a9e1-4997-8ea3-6e5e2685b0c3" containerName="authorino" Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857366 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4887d6a0-d1af-41e8-85ee-0dd15823d8a2" containerName="authorino" Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857375 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="12dc2242-bbac-4ea2-b085-65589e047c0b" containerName="authorino" Jul 02 15:03:01.857404 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.857381 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a29d47-a9e1-4997-8ea3-6e5e2685b0c3" containerName="authorino" Jul 02 15:03:01.860321 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.860303 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:01.864128 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.864101 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 15:03:01.864128 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.864123 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-65fcc\"" Jul 02 15:03:01.865703 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.865683 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 15:03:01.870667 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.870631 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff55dd5d9-vfk8h"] Jul 02 15:03:01.892445 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.892412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:01.957677 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.957619 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xm6b\" (UniqueName: \"kubernetes.io/projected/b4e690ad-8abc-4454-843c-978aa59d9cc8-kube-api-access-4xm6b\") pod \"maas-controller-6ff55dd5d9-vfk8h\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:01.957677 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.957682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert\") pod \"maas-controller-6ff55dd5d9-vfk8h\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:01.991061 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:01.991007 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:02.043048 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.043010 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59f9dd4b66-82xv4"] Jul 02 15:03:02.045315 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.045291 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:02.054832 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.054803 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f9dd4b66-82xv4"] Jul 02 15:03:02.058549 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.058528 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xm6b\" (UniqueName: \"kubernetes.io/projected/b4e690ad-8abc-4454-843c-978aa59d9cc8-kube-api-access-4xm6b\") pod \"maas-controller-6ff55dd5d9-vfk8h\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:02.058688 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.058559 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert\") pod \"maas-controller-6ff55dd5d9-vfk8h\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:02.058748 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:03:02.058693 2559 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 02 15:03:02.058748 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:03:02.058742 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert podName:b4e690ad-8abc-4454-843c-978aa59d9cc8 nodeName:}" failed. No retries permitted until 2026-07-02 15:03:02.558726971 +0000 UTC m=+889.895783713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert") pod "maas-controller-6ff55dd5d9-vfk8h" (UID: "b4e690ad-8abc-4454-843c-978aa59d9cc8") : secret "maas-controller-webhook-cert" not found Jul 02 15:03:02.073121 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.073096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xm6b\" (UniqueName: \"kubernetes.io/projected/b4e690ad-8abc-4454-843c-978aa59d9cc8-kube-api-access-4xm6b\") pod \"maas-controller-6ff55dd5d9-vfk8h\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:02.159525 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.159431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl7wb\" (UniqueName: \"kubernetes.io/projected/072dab6c-6893-42f6-bf73-cb57d68931bc-kube-api-access-tl7wb\") pod \"maas-controller-59f9dd4b66-82xv4\" (UID: \"072dab6c-6893-42f6-bf73-cb57d68931bc\") " pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:02.159525 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.159507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072dab6c-6893-42f6-bf73-cb57d68931bc-webhook-cert\") pod \"maas-controller-59f9dd4b66-82xv4\" (UID: \"072dab6c-6893-42f6-bf73-cb57d68931bc\") " pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:02.260458 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.260422 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl7wb\" (UniqueName: \"kubernetes.io/projected/072dab6c-6893-42f6-bf73-cb57d68931bc-kube-api-access-tl7wb\") pod \"maas-controller-59f9dd4b66-82xv4\" (UID: \"072dab6c-6893-42f6-bf73-cb57d68931bc\") " pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:02.260588 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.260504 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072dab6c-6893-42f6-bf73-cb57d68931bc-webhook-cert\") pod \"maas-controller-59f9dd4b66-82xv4\" (UID: \"072dab6c-6893-42f6-bf73-cb57d68931bc\") " pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:02.262989 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.262960 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072dab6c-6893-42f6-bf73-cb57d68931bc-webhook-cert\") pod \"maas-controller-59f9dd4b66-82xv4\" (UID: \"072dab6c-6893-42f6-bf73-cb57d68931bc\") " pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:02.270005 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.269984 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl7wb\" (UniqueName: \"kubernetes.io/projected/072dab6c-6893-42f6-bf73-cb57d68931bc-kube-api-access-tl7wb\") pod \"maas-controller-59f9dd4b66-82xv4\" (UID: \"072dab6c-6893-42f6-bf73-cb57d68931bc\") " pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:02.325206 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.325170 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:02.355218 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.355185 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:02.483572 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.483546 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f9dd4b66-82xv4"] Jul 02 15:03:02.485334 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:03:02.485309 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072dab6c_6893_42f6_bf73_cb57d68931bc.slice/crio-c43a37ba68400adf782ef72b2cbd3bacbc829a9d3db109c644ebdd52d505741f WatchSource:0}: Error finding container c43a37ba68400adf782ef72b2cbd3bacbc829a9d3db109c644ebdd52d505741f: Status 404 returned error can't find the container with id c43a37ba68400adf782ef72b2cbd3bacbc829a9d3db109c644ebdd52d505741f Jul 02 15:03:02.564210 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.564168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert\") pod \"maas-controller-6ff55dd5d9-vfk8h\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:02.566634 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.566615 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert\") pod \"maas-controller-6ff55dd5d9-vfk8h\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:02.770616 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.770577 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:02.899333 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:02.899307 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff55dd5d9-vfk8h"] Jul 02 15:03:02.901141 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:03:02.901117 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e690ad_8abc_4454_843c_978aa59d9cc8.slice/crio-91551a54ff328ab7fae1e0223e876e6557b683491455e06f3c2c33f76d31d7cf WatchSource:0}: Error finding container 91551a54ff328ab7fae1e0223e876e6557b683491455e06f3c2c33f76d31d7cf: Status 404 returned error can't find the container with id 91551a54ff328ab7fae1e0223e876e6557b683491455e06f3c2c33f76d31d7cf Jul 02 15:03:03.439041 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:03.439004 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" event={"ID":"b4e690ad-8abc-4454-843c-978aa59d9cc8","Type":"ContainerStarted","Data":"91551a54ff328ab7fae1e0223e876e6557b683491455e06f3c2c33f76d31d7cf"} Jul 02 15:03:03.440205 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:03.440178 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f9dd4b66-82xv4" event={"ID":"072dab6c-6893-42f6-bf73-cb57d68931bc","Type":"ContainerStarted","Data":"c43a37ba68400adf782ef72b2cbd3bacbc829a9d3db109c644ebdd52d505741f"} Jul 02 15:03:05.907476 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:05.907433 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:06.002377 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:06.002337 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:06.455033 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:06.454933 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" event={"ID":"b4e690ad-8abc-4454-843c-978aa59d9cc8","Type":"ContainerStarted","Data":"fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54"} Jul 02 15:03:06.455202 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:06.455052 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:06.456567 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:06.456541 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f9dd4b66-82xv4" event={"ID":"072dab6c-6893-42f6-bf73-cb57d68931bc","Type":"ContainerStarted","Data":"173124113b744d9f4bbafe7794f2a335f7fa72baf446b5fe881e2e4b1c8e2ab4"} Jul 02 15:03:06.456706 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:06.456594 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:06.473149 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:06.473108 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" podStartSLOduration=2.67070956 podStartE2EDuration="5.473097748s" totalImagesPullingTime="2.802388188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:03:06.472493419 +0000 UTC m=+893.809550202" watchObservedRunningTime="2026-07-02 15:03:06.473097748 +0000 UTC m=+893.810154513" Jul 02 15:03:06.491155 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:06.491115 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59f9dd4b66-82xv4" podStartSLOduration=1.281572568 podStartE2EDuration="4.491099189s" totalImagesPullingTime="3.209526621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:03:06.490822711 +0000 UTC m=+893.827879475" watchObservedRunningTime="2026-07-02 15:03:06.491099189 +0000 UTC m=+893.828155955" Jul 02 15:03:13.126305 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:13.126276 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 15:03:13.126870 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:13.126452 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jmbqz_b3b0ee35-fe39-449c-964f-bd291f1fbaf4/ovn-acl-logging/0.log" Jul 02 15:03:17.466005 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.465972 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59f9dd4b66-82xv4" Jul 02 15:03:17.466378 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.466099 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:17.530474 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.530446 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ff55dd5d9-vfk8h"] Jul 02 15:03:17.530718 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.530692 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" podUID="b4e690ad-8abc-4454-843c-978aa59d9cc8" containerName="manager" containerID="cri-o://fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54" gracePeriod=30 Jul 02 15:03:17.772742 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.772712 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:17.885697 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.885667 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xm6b\" (UniqueName: \"kubernetes.io/projected/b4e690ad-8abc-4454-843c-978aa59d9cc8-kube-api-access-4xm6b\") pod \"b4e690ad-8abc-4454-843c-978aa59d9cc8\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " Jul 02 15:03:17.885883 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.885737 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert\") pod \"b4e690ad-8abc-4454-843c-978aa59d9cc8\" (UID: \"b4e690ad-8abc-4454-843c-978aa59d9cc8\") " Jul 02 15:03:17.888018 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.887991 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4e690ad-8abc-4454-843c-978aa59d9cc8-kube-api-access-4xm6b" (OuterVolumeSpecName: "kube-api-access-4xm6b") pod "b4e690ad-8abc-4454-843c-978aa59d9cc8" (UID: "b4e690ad-8abc-4454-843c-978aa59d9cc8"). InnerVolumeSpecName "kube-api-access-4xm6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:03:17.888127 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.888022 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b4e690ad-8abc-4454-843c-978aa59d9cc8" (UID: "b4e690ad-8abc-4454-843c-978aa59d9cc8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:03:17.986857 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.986828 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xm6b\" (UniqueName: \"kubernetes.io/projected/b4e690ad-8abc-4454-843c-978aa59d9cc8-kube-api-access-4xm6b\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:03:17.986857 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:17.986853 2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4e690ad-8abc-4454-843c-978aa59d9cc8-webhook-cert\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:03:18.504662 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.504614 2559 generic.go:356] "Generic (PLEG): container finished" podID="b4e690ad-8abc-4454-843c-978aa59d9cc8" containerID="fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54" exitCode=0 Jul 02 15:03:18.507021 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.504678 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" Jul 02 15:03:18.507021 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.504704 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" event={"ID":"b4e690ad-8abc-4454-843c-978aa59d9cc8","Type":"ContainerDied","Data":"fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54"} Jul 02 15:03:18.507021 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.504757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff55dd5d9-vfk8h" event={"ID":"b4e690ad-8abc-4454-843c-978aa59d9cc8","Type":"ContainerDied","Data":"91551a54ff328ab7fae1e0223e876e6557b683491455e06f3c2c33f76d31d7cf"} Jul 02 15:03:18.507021 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.504780 2559 scope.go:117] "RemoveContainer" containerID="fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54" Jul 02 15:03:18.513354 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.513339 2559 scope.go:117] "RemoveContainer" containerID="fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54" Jul 02 15:03:18.513583 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:03:18.513567 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54\": container with ID starting with fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54 not found: ID does not exist" containerID="fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54" Jul 02 15:03:18.513632 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.513589 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54"} err="failed to get container status \"fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54\": rpc error: code = NotFound desc = could not find container \"fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54\": container with ID starting with fedda6011972f1a555efb6c52f79111f4cd13ce3d34418bd11eb26bbc8843a54 not found: ID does not exist" Jul 02 15:03:18.532578 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.532554 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ff55dd5d9-vfk8h"] Jul 02 15:03:18.537479 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:18.537460 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6ff55dd5d9-vfk8h"] Jul 02 15:03:19.158295 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:19.158262 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4e690ad-8abc-4454-843c-978aa59d9cc8" path="/var/lib/kubelet/pods/b4e690ad-8abc-4454-843c-978aa59d9cc8/volumes" Jul 02 15:03:39.929194 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:39.929152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:40.957088 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.957058 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl"] Jul 02 15:03:40.957474 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.957331 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4e690ad-8abc-4454-843c-978aa59d9cc8" containerName="manager" Jul 02 15:03:40.957474 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.957342 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4e690ad-8abc-4454-843c-978aa59d9cc8" containerName="manager" Jul 02 15:03:40.957474 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.957402 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4e690ad-8abc-4454-843c-978aa59d9cc8" containerName="manager" Jul 02 15:03:40.960271 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.960255 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:40.963370 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.963351 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-r6qqs\"" Jul 02 15:03:40.963499 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.963370 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 15:03:40.970621 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.970596 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl"] Jul 02 15:03:40.974099 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.974067 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-w6qnp"] Jul 02 15:03:40.977133 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.977111 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:40.986356 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:40.986336 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-w6qnp"] Jul 02 15:03:41.059504 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.059470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f25a3ce6-5066-4975-a3bf-4538ea645a81-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-4pzzl\" (UID: \"f25a3ce6-5066-4975-a3bf-4538ea645a81\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:41.059631 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.059509 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75973978-4a59-477a-897f-528ebb1bed58-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-w6qnp\" (UID: \"75973978-4a59-477a-897f-528ebb1bed58\") " pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:41.059631 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.059541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7kzg\" (UniqueName: \"kubernetes.io/projected/75973978-4a59-477a-897f-528ebb1bed58-kube-api-access-k7kzg\") pod \"payload-processing-7bbcb654f4-w6qnp\" (UID: \"75973978-4a59-477a-897f-528ebb1bed58\") " pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:41.059631 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.059580 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2n8d\" (UniqueName: \"kubernetes.io/projected/f25a3ce6-5066-4975-a3bf-4538ea645a81-kube-api-access-b2n8d\") pod \"payload-pre-processing-59f49fd4f6-4pzzl\" (UID: \"f25a3ce6-5066-4975-a3bf-4538ea645a81\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:41.160885 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.160853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75973978-4a59-477a-897f-528ebb1bed58-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-w6qnp\" (UID: \"75973978-4a59-477a-897f-528ebb1bed58\") " pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:41.161060 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.160903 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7kzg\" (UniqueName: \"kubernetes.io/projected/75973978-4a59-477a-897f-528ebb1bed58-kube-api-access-k7kzg\") pod \"payload-processing-7bbcb654f4-w6qnp\" (UID: \"75973978-4a59-477a-897f-528ebb1bed58\") " pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:41.161060 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.160919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2n8d\" (UniqueName: \"kubernetes.io/projected/f25a3ce6-5066-4975-a3bf-4538ea645a81-kube-api-access-b2n8d\") pod \"payload-pre-processing-59f49fd4f6-4pzzl\" (UID: \"f25a3ce6-5066-4975-a3bf-4538ea645a81\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:41.161060 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.160960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f25a3ce6-5066-4975-a3bf-4538ea645a81-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-4pzzl\" (UID: \"f25a3ce6-5066-4975-a3bf-4538ea645a81\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:41.161584 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.161566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f25a3ce6-5066-4975-a3bf-4538ea645a81-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-4pzzl\" (UID: \"f25a3ce6-5066-4975-a3bf-4538ea645a81\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:41.161629 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.161610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75973978-4a59-477a-897f-528ebb1bed58-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-w6qnp\" (UID: \"75973978-4a59-477a-897f-528ebb1bed58\") " pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:41.174047 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.174026 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7kzg\" (UniqueName: \"kubernetes.io/projected/75973978-4a59-477a-897f-528ebb1bed58-kube-api-access-k7kzg\") pod \"payload-processing-7bbcb654f4-w6qnp\" (UID: \"75973978-4a59-477a-897f-528ebb1bed58\") " pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:41.174177 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.174114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2n8d\" (UniqueName: \"kubernetes.io/projected/f25a3ce6-5066-4975-a3bf-4538ea645a81-kube-api-access-b2n8d\") pod \"payload-pre-processing-59f49fd4f6-4pzzl\" (UID: \"f25a3ce6-5066-4975-a3bf-4538ea645a81\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:41.235168 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.235141 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:41.272241 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.272217 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:41.287322 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.287298 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:41.411301 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.411274 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl"] Jul 02 15:03:41.413084 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:03:41.413056 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf25a3ce6_5066_4975_a3bf_4538ea645a81.slice/crio-f454b3f274a8d04eab5345be298c5dc0158b1ca8eb773e97fa0337d1522a70c3 WatchSource:0}: Error finding container f454b3f274a8d04eab5345be298c5dc0158b1ca8eb773e97fa0337d1522a70c3: Status 404 returned error can't find the container with id f454b3f274a8d04eab5345be298c5dc0158b1ca8eb773e97fa0337d1522a70c3 Jul 02 15:03:41.415053 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.415037 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:03:41.429725 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.429704 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-w6qnp"] Jul 02 15:03:41.431191 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:03:41.431167 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75973978_4a59_477a_897f_528ebb1bed58.slice/crio-e369e7afb0d5a4e2434dc0cba193593a1fd918c95955c97727bf7e45818de323 WatchSource:0}: Error finding container e369e7afb0d5a4e2434dc0cba193593a1fd918c95955c97727bf7e45818de323: Status 404 returned error can't find the container with id e369e7afb0d5a4e2434dc0cba193593a1fd918c95955c97727bf7e45818de323 Jul 02 15:03:41.603708 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.603588 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" event={"ID":"75973978-4a59-477a-897f-528ebb1bed58","Type":"ContainerStarted","Data":"e369e7afb0d5a4e2434dc0cba193593a1fd918c95955c97727bf7e45818de323"} Jul 02 15:03:41.604780 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:41.604753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" event={"ID":"f25a3ce6-5066-4975-a3bf-4538ea645a81","Type":"ContainerStarted","Data":"f454b3f274a8d04eab5345be298c5dc0158b1ca8eb773e97fa0337d1522a70c3"} Jul 02 15:03:44.623520 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:44.623483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" event={"ID":"75973978-4a59-477a-897f-528ebb1bed58","Type":"ContainerStarted","Data":"a5f8df61bea63e7fd75bba489509720941468f4ff682e718694f1997b40194c1"} Jul 02 15:03:44.623959 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:44.623598 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:44.624950 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:44.624926 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" event={"ID":"f25a3ce6-5066-4975-a3bf-4538ea645a81","Type":"ContainerStarted","Data":"82af54f4d6ddcc039ddfea333209ab00b79595e20af63719887bbd0ffc87ce0c"} Jul 02 15:03:44.625067 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:44.624990 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:44.644638 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:44.644599 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" podStartSLOduration=1.967807686 podStartE2EDuration="4.644586612s" totalImagesPullingTime="2.676778926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:03:44.642673186 +0000 UTC m=+931.979729962" watchObservedRunningTime="2026-07-02 15:03:44.644586612 +0000 UTC m=+931.981643354" Jul 02 15:03:44.659066 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:44.659027 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" podStartSLOduration=1.9697608789999999 podStartE2EDuration="4.659014169s" totalImagesPullingTime="2.68925329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:03:44.658219494 +0000 UTC m=+931.995276258" watchObservedRunningTime="2026-07-02 15:03:44.659014169 +0000 UTC m=+931.996070933" Jul 02 15:03:51.137144 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:51.137112 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:03:51.137691 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:51.137335 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" containerID="cri-o://0377c80b13a9ff0c98ba4827fe1134b84bcf4a9ab68697d7ed6b0fc4cb3f8398" gracePeriod=30 Jul 02 15:03:52.658470 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:52.658443 2559 generic.go:356] "Generic (PLEG): container finished" podID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerID="0377c80b13a9ff0c98ba4827fe1134b84bcf4a9ab68697d7ed6b0fc4cb3f8398" exitCode=143 Jul 02 15:03:52.658819 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:52.658517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"62bac272-88f8-4e36-b6a9-d98114034fc2","Type":"ContainerDied","Data":"0377c80b13a9ff0c98ba4827fe1134b84bcf4a9ab68697d7ed6b0fc4cb3f8398"} Jul 02 15:03:52.778126 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:52.778102 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:52.957958 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:52.957877 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p75q6\" (UniqueName: \"kubernetes.io/projected/62bac272-88f8-4e36-b6a9-d98114034fc2-kube-api-access-p75q6\") pod \"62bac272-88f8-4e36-b6a9-d98114034fc2\" (UID: \"62bac272-88f8-4e36-b6a9-d98114034fc2\") " Jul 02 15:03:52.960068 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:52.960037 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62bac272-88f8-4e36-b6a9-d98114034fc2-kube-api-access-p75q6" (OuterVolumeSpecName: "kube-api-access-p75q6") pod "62bac272-88f8-4e36-b6a9-d98114034fc2" (UID: "62bac272-88f8-4e36-b6a9-d98114034fc2"). InnerVolumeSpecName "kube-api-access-p75q6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:03:53.058428 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.058398 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p75q6\" (UniqueName: \"kubernetes.io/projected/62bac272-88f8-4e36-b6a9-d98114034fc2-kube-api-access-p75q6\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:03:53.663827 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.663795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"62bac272-88f8-4e36-b6a9-d98114034fc2","Type":"ContainerDied","Data":"fceb3847be8fafd08a966b054340129413cdd6e26f80d7b8557b6ebf9f6aa9b9"} Jul 02 15:03:53.663827 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.663821 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:53.664311 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.663847 2559 scope.go:117] "RemoveContainer" containerID="0377c80b13a9ff0c98ba4827fe1134b84bcf4a9ab68697d7ed6b0fc4cb3f8398" Jul 02 15:03:53.690732 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.690705 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:03:53.693666 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.693630 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:03:53.744805 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.744778 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:03:53.745066 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.745053 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" Jul 02 15:03:53.745108 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.745069 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" Jul 02 15:03:53.745162 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.745153 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" containerName="keycloak" Jul 02 15:03:53.749201 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.749184 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:53.753219 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.753203 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 02 15:03:53.753292 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.753242 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 15:03:53.753292 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.753269 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 02 15:03:53.753719 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.753704 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 15:03:53.753789 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.753735 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-fckmt\"" Jul 02 15:03:53.767403 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.767383 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:03:53.864187 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.864154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8k69\" (UniqueName: \"kubernetes.io/projected/ee2d3c80-f201-47c1-98a1-d128e59e2c76-kube-api-access-k8k69\") pod \"maas-keycloak-0\" (UID: \"ee2d3c80-f201-47c1-98a1-d128e59e2c76\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:53.864373 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.864217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ee2d3c80-f201-47c1-98a1-d128e59e2c76-test-realms\") pod \"maas-keycloak-0\" (UID: \"ee2d3c80-f201-47c1-98a1-d128e59e2c76\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:53.965379 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.965354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8k69\" (UniqueName: \"kubernetes.io/projected/ee2d3c80-f201-47c1-98a1-d128e59e2c76-kube-api-access-k8k69\") pod \"maas-keycloak-0\" (UID: \"ee2d3c80-f201-47c1-98a1-d128e59e2c76\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:53.965506 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.965406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ee2d3c80-f201-47c1-98a1-d128e59e2c76-test-realms\") pod \"maas-keycloak-0\" (UID: \"ee2d3c80-f201-47c1-98a1-d128e59e2c76\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:53.966061 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.966033 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/ee2d3c80-f201-47c1-98a1-d128e59e2c76-test-realms\") pod \"maas-keycloak-0\" (UID: \"ee2d3c80-f201-47c1-98a1-d128e59e2c76\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:53.974917 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:53.974889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8k69\" (UniqueName: \"kubernetes.io/projected/ee2d3c80-f201-47c1-98a1-d128e59e2c76-kube-api-access-k8k69\") pod \"maas-keycloak-0\" (UID: \"ee2d3c80-f201-47c1-98a1-d128e59e2c76\") " pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:54.058643 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:54.058614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:54.191370 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:54.191218 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 02 15:03:54.194067 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:03:54.194037 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2d3c80_f201_47c1_98a1_d128e59e2c76.slice/crio-10f6d60aad0e22ea224983c10f12cc72d60fe93176e62df40611ad4fa5aa8a7d WatchSource:0}: Error finding container 10f6d60aad0e22ea224983c10f12cc72d60fe93176e62df40611ad4fa5aa8a7d: Status 404 returned error can't find the container with id 10f6d60aad0e22ea224983c10f12cc72d60fe93176e62df40611ad4fa5aa8a7d Jul 02 15:03:54.671585 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:54.671548 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ee2d3c80-f201-47c1-98a1-d128e59e2c76","Type":"ContainerStarted","Data":"31cfab7148e8cc331ae63637d58bf88a2be1b0e356577ab05d8e19507f41f0c0"} Jul 02 15:03:54.672014 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:54.671640 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"ee2d3c80-f201-47c1-98a1-d128e59e2c76","Type":"ContainerStarted","Data":"10f6d60aad0e22ea224983c10f12cc72d60fe93176e62df40611ad4fa5aa8a7d"} Jul 02 15:03:54.692304 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:54.692229 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.367288946 podStartE2EDuration="1.692215431s" totalImagesPullingTime="324.926485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:03:54.690918524 +0000 UTC m=+942.027975291" watchObservedRunningTime="2026-07-02 15:03:54.692215431 +0000 UTC m=+942.029272195" Jul 02 15:03:55.059599 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:55.059560 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 02 15:03:55.060810 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:55.060777 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:03:55.158079 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:55.158045 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62bac272-88f8-4e36-b6a9-d98114034fc2" path="/var/lib/kubelet/pods/62bac272-88f8-4e36-b6a9-d98114034fc2/volumes" Jul 02 15:03:55.630858 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:55.630824 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:03:55.631033 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:55.630899 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-4pzzl" Jul 02 15:03:56.059137 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:56.059084 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:03:56.904420 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:56.904385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:56.965110 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:56.965050 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:03:57.060026 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:57.059981 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:03:58.059708 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:58.059638 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:03:59.060087 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:03:59.060036 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:00.059097 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:00.059043 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:01.059373 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:01.059325 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:02.059271 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:02.059215 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:03.059733 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:03.059679 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:04.058772 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:04.058736 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 02 15:04:04.059209 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:04.059169 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:05.060057 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:05.060004 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:06.059422 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:06.059371 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:07.059138 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:07.059081 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.31:9000/health/started\": dial tcp 10.132.0.31:9000: connect: connection refused" Jul 02 15:04:08.184500 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:08.184458 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 02 15:04:08.201933 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:08.201889 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="ee2d3c80-f201-47c1-98a1-d128e59e2c76" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 15:04:18.190768 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:18.190735 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 02 15:04:27.428270 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:27.428237 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:04:28.908191 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:28.908151 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74fcf49566-jmkz4"] Jul 02 15:04:28.915469 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:28.915446 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:28.918635 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:28.918611 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 02 15:04:28.918635 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:28.918634 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74fcf49566-jmkz4"] Jul 02 15:04:29.056712 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.056686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwrkx\" (UniqueName: \"kubernetes.io/projected/78001d32-282b-49ea-be29-b43a84447e25-kube-api-access-nwrkx\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.056849 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.056742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/78001d32-282b-49ea-be29-b43a84447e25-oidc-ca\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.056849 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.056777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78001d32-282b-49ea-be29-b43a84447e25-tls-cert\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.157067 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.157037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/78001d32-282b-49ea-be29-b43a84447e25-oidc-ca\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.157223 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.157083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78001d32-282b-49ea-be29-b43a84447e25-tls-cert\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.157223 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.157117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwrkx\" (UniqueName: \"kubernetes.io/projected/78001d32-282b-49ea-be29-b43a84447e25-kube-api-access-nwrkx\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.157876 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.157826 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/78001d32-282b-49ea-be29-b43a84447e25-oidc-ca\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.159698 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.159621 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78001d32-282b-49ea-be29-b43a84447e25-tls-cert\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.165479 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.165455 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwrkx\" (UniqueName: \"kubernetes.io/projected/78001d32-282b-49ea-be29-b43a84447e25-kube-api-access-nwrkx\") pod \"authorino-74fcf49566-jmkz4\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.225955 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.225904 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:04:29.350417 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.350393 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74fcf49566-jmkz4"] Jul 02 15:04:29.352194 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:04:29.352168 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod78001d32_282b_49ea_be29_b43a84447e25.slice/crio-e0a6705ccb912d22550e8acdc047cc5588c3a3a046f3dc4b921059cba49b9c18 WatchSource:0}: Error finding container e0a6705ccb912d22550e8acdc047cc5588c3a3a046f3dc4b921059cba49b9c18: Status 404 returned error can't find the container with id e0a6705ccb912d22550e8acdc047cc5588c3a3a046f3dc4b921059cba49b9c18 Jul 02 15:04:29.842244 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.842210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fcf49566-jmkz4" event={"ID":"78001d32-282b-49ea-be29-b43a84447e25","Type":"ContainerStarted","Data":"592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7"} Jul 02 15:04:29.842403 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.842262 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fcf49566-jmkz4" event={"ID":"78001d32-282b-49ea-be29-b43a84447e25","Type":"ContainerStarted","Data":"e0a6705ccb912d22550e8acdc047cc5588c3a3a046f3dc4b921059cba49b9c18"} Jul 02 15:04:29.860079 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.860028 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74fcf49566-jmkz4" podStartSLOduration=1.4810652 podStartE2EDuration="1.860008485s" totalImagesPullingTime="378.943285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:04:29.859181282 +0000 UTC m=+977.196238047" watchObservedRunningTime="2026-07-02 15:04:29.860008485 +0000 UTC m=+977.197065249" Jul 02 15:04:29.891921 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.891887 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c55765c56-7brtl"] Jul 02 15:04:29.892118 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:29.892091 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6c55765c56-7brtl" podUID="41bc094e-7177-4fc3-9764-b6ed70eec762" containerName="authorino" containerID="cri-o://1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b" gracePeriod=30 Jul 02 15:04:30.128194 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.128170 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:04:30.266701 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.266626 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41bc094e-7177-4fc3-9764-b6ed70eec762-tls-cert\") pod \"41bc094e-7177-4fc3-9764-b6ed70eec762\" (UID: \"41bc094e-7177-4fc3-9764-b6ed70eec762\") " Jul 02 15:04:30.266828 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.266704 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb9dv\" (UniqueName: \"kubernetes.io/projected/41bc094e-7177-4fc3-9764-b6ed70eec762-kube-api-access-zb9dv\") pod \"41bc094e-7177-4fc3-9764-b6ed70eec762\" (UID: \"41bc094e-7177-4fc3-9764-b6ed70eec762\") " Jul 02 15:04:30.268736 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.268710 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41bc094e-7177-4fc3-9764-b6ed70eec762-kube-api-access-zb9dv" (OuterVolumeSpecName: "kube-api-access-zb9dv") pod "41bc094e-7177-4fc3-9764-b6ed70eec762" (UID: "41bc094e-7177-4fc3-9764-b6ed70eec762"). InnerVolumeSpecName "kube-api-access-zb9dv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:04:30.276069 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.276044 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41bc094e-7177-4fc3-9764-b6ed70eec762-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "41bc094e-7177-4fc3-9764-b6ed70eec762" (UID: "41bc094e-7177-4fc3-9764-b6ed70eec762"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:04:30.367445 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.367414 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41bc094e-7177-4fc3-9764-b6ed70eec762-tls-cert\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:04:30.367445 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.367441 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb9dv\" (UniqueName: \"kubernetes.io/projected/41bc094e-7177-4fc3-9764-b6ed70eec762-kube-api-access-zb9dv\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:04:30.756935 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.756903 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:04:30.847752 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.847717 2559 generic.go:356] "Generic (PLEG): container finished" podID="41bc094e-7177-4fc3-9764-b6ed70eec762" containerID="1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b" exitCode=0 Jul 02 15:04:30.847970 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.847766 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c55765c56-7brtl" Jul 02 15:04:30.847970 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.847801 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c55765c56-7brtl" event={"ID":"41bc094e-7177-4fc3-9764-b6ed70eec762","Type":"ContainerDied","Data":"1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b"} Jul 02 15:04:30.847970 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.847847 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c55765c56-7brtl" event={"ID":"41bc094e-7177-4fc3-9764-b6ed70eec762","Type":"ContainerDied","Data":"2ae3f0a071be6980c8c00f8b284ffc9bd51d8ad9df1f6a2d17943a48c605715c"} Jul 02 15:04:30.847970 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.847870 2559 scope.go:117] "RemoveContainer" containerID="1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b" Jul 02 15:04:30.858543 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.858522 2559 scope.go:117] "RemoveContainer" containerID="1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b" Jul 02 15:04:30.858863 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:04:30.858843 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b\": container with ID starting with 1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b not found: ID does not exist" containerID="1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b" Jul 02 15:04:30.858925 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.858872 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b"} err="failed to get container status \"1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b\": rpc error: code = NotFound desc = could not find container \"1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b\": container with ID starting with 1e5b31d6dc3753beb8290b712282ede6871f51219af176bc0726653c70c04c7b not found: ID does not exist" Jul 02 15:04:30.865571 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.865548 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:04:30.879969 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.879949 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c55765c56-7brtl"] Jul 02 15:04:30.913279 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:30.913257 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c55765c56-7brtl"] Jul 02 15:04:31.157748 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:31.157669 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41bc094e-7177-4fc3-9764-b6ed70eec762" path="/var/lib/kubelet/pods/41bc094e-7177-4fc3-9764-b6ed70eec762/volumes" Jul 02 15:04:36.798080 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.794327 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5"] Jul 02 15:04:36.798080 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.794687 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41bc094e-7177-4fc3-9764-b6ed70eec762" containerName="authorino" Jul 02 15:04:36.798080 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.794699 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="41bc094e-7177-4fc3-9764-b6ed70eec762" containerName="authorino" Jul 02 15:04:36.798080 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.794753 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="41bc094e-7177-4fc3-9764-b6ed70eec762" containerName="authorino" Jul 02 15:04:36.798847 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.798830 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:36.802792 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.802736 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xv29t\"" Jul 02 15:04:36.802792 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.802747 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 15:04:36.802994 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.802888 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 15:04:36.804574 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.804551 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 15:04:36.808727 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.808702 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5"] Jul 02 15:04:36.831414 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.831384 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:04:36.922617 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.922585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:36.922780 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.922624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:36.922780 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.922659 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:36.922780 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.922700 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:36.922780 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.922740 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/332b6de7-2e3c-4a97-8b77-46737b2cc004-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:36.922780 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:36.922768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg4k2\" (UniqueName: \"kubernetes.io/projected/332b6de7-2e3c-4a97-8b77-46737b2cc004-kube-api-access-fg4k2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024006 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.023972 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024140 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.024011 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024140 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.024032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024140 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.024057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024140 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.024103 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/332b6de7-2e3c-4a97-8b77-46737b2cc004-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024140 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.024129 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg4k2\" (UniqueName: \"kubernetes.io/projected/332b6de7-2e3c-4a97-8b77-46737b2cc004-kube-api-access-fg4k2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024514 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.024492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024577 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.024527 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.024577 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.024528 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.026449 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.026431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/332b6de7-2e3c-4a97-8b77-46737b2cc004-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.026598 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.026581 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/332b6de7-2e3c-4a97-8b77-46737b2cc004-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.035260 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.035239 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg4k2\" (UniqueName: \"kubernetes.io/projected/332b6de7-2e3c-4a97-8b77-46737b2cc004-kube-api-access-fg4k2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5\" (UID: \"332b6de7-2e3c-4a97-8b77-46737b2cc004\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.110145 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.110078 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:37.250709 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.250605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5"] Jul 02 15:04:37.253232 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:04:37.253195 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332b6de7_2e3c_4a97_8b77_46737b2cc004.slice/crio-d77519cadcda49c4aed1cdad43e2baf330d9b8784d2ad50d091c47fed22644c2 WatchSource:0}: Error finding container d77519cadcda49c4aed1cdad43e2baf330d9b8784d2ad50d091c47fed22644c2: Status 404 returned error can't find the container with id d77519cadcda49c4aed1cdad43e2baf330d9b8784d2ad50d091c47fed22644c2 Jul 02 15:04:37.881314 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:37.881268 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" event={"ID":"332b6de7-2e3c-4a97-8b77-46737b2cc004","Type":"ContainerStarted","Data":"d77519cadcda49c4aed1cdad43e2baf330d9b8784d2ad50d091c47fed22644c2"} Jul 02 15:04:38.888316 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:38.888236 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" event={"ID":"332b6de7-2e3c-4a97-8b77-46737b2cc004","Type":"ContainerStarted","Data":"27ec14d455bd5483866f7691e6f60425c793d608a51e44885310a313b610529c"} Jul 02 15:04:38.908692 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:38.908621 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" podStartSLOduration=1.58944367 podStartE2EDuration="2.908605935s" totalImagesPullingTime="1.319162265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:04:38.906544038 +0000 UTC m=+986.243600830" watchObservedRunningTime="2026-07-02 15:04:38.908605935 +0000 UTC m=+986.245662698" Jul 02 15:04:47.110363 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:47.110327 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:47.110842 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:47.110385 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:47.123110 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:47.123087 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:47.934955 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:47.934924 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5" Jul 02 15:04:52.008790 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:52.008753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:04:55.887607 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:55.887572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:04:58.419296 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:58.419220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:04:59.827726 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:04:59.827683 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:05:03.030478 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:03.030437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:05:04.319891 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:04.319856 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:05:13.500633 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.500596 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp"] Jul 02 15:05:13.507250 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.507229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.510525 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.510503 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 02 15:05:13.515766 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.515744 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp"] Jul 02 15:05:13.532054 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.532024 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:05:13.615218 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.615184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e17690b0-25ba-4124-8f0f-6aa284e90e1d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.615341 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.615229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.615341 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.615244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.615341 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.615319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b28f\" (UniqueName: \"kubernetes.io/projected/e17690b0-25ba-4124-8f0f-6aa284e90e1d-kube-api-access-9b28f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.615457 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.615398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.615457 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.615427 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716016 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.715983 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e17690b0-25ba-4124-8f0f-6aa284e90e1d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716164 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.716025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716164 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.716047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716164 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.716073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b28f\" (UniqueName: \"kubernetes.io/projected/e17690b0-25ba-4124-8f0f-6aa284e90e1d-kube-api-access-9b28f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716164 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.716125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716164 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.716149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716424 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.716400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716562 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.716509 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.716616 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.716557 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.718456 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.718432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e17690b0-25ba-4124-8f0f-6aa284e90e1d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.718636 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.718620 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e17690b0-25ba-4124-8f0f-6aa284e90e1d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.726907 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.726885 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b28f\" (UniqueName: \"kubernetes.io/projected/e17690b0-25ba-4124-8f0f-6aa284e90e1d-kube-api-access-9b28f\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k9rqp\" (UID: \"e17690b0-25ba-4124-8f0f-6aa284e90e1d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.817188 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.817121 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:13.943158 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:13.943137 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp"] Jul 02 15:05:13.945083 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:05:13.945055 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17690b0_25ba_4124_8f0f_6aa284e90e1d.slice/crio-06182de41eb6b624ae8bb421df0233f45e53dc45fc0bf9091a02575b5d77d8b7 WatchSource:0}: Error finding container 06182de41eb6b624ae8bb421df0233f45e53dc45fc0bf9091a02575b5d77d8b7: Status 404 returned error can't find the container with id 06182de41eb6b624ae8bb421df0233f45e53dc45fc0bf9091a02575b5d77d8b7 Jul 02 15:05:14.030407 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:14.030375 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" event={"ID":"e17690b0-25ba-4124-8f0f-6aa284e90e1d","Type":"ContainerStarted","Data":"06182de41eb6b624ae8bb421df0233f45e53dc45fc0bf9091a02575b5d77d8b7"} Jul 02 15:05:15.036376 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:15.036344 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" event={"ID":"e17690b0-25ba-4124-8f0f-6aa284e90e1d","Type":"ContainerStarted","Data":"25e7b11f81f56280b900c531f9c4c21f99771a04e194966e163cc74b3616bfa4"} Jul 02 15:05:15.054317 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:15.054274 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" podStartSLOduration=1.775608139 podStartE2EDuration="2.054257581s" totalImagesPullingTime="278.649442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:05:15.053948607 +0000 UTC m=+1022.391005393" watchObservedRunningTime="2026-07-02 15:05:15.054257581 +0000 UTC m=+1022.391314345" Jul 02 15:05:21.405616 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:21.405583 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:05:23.817664 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:23.817630 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:23.818053 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:23.817697 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:23.830434 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:23.830406 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:24.085922 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:24.085839 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k9rqp" Jul 02 15:05:44.642216 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:05:44.642175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:06:28.238161 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.238085 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-564d4cfdf9-b9nr2"] Jul 02 15:06:28.241293 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.241273 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.249892 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.249863 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-564d4cfdf9-b9nr2"] Jul 02 15:06:28.319016 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.318988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a797429-2125-4382-882c-c66a004f681c-tls-cert\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.319016 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.319032 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4a797429-2125-4382-882c-c66a004f681c-oidc-ca\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.319216 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.319096 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfp77\" (UniqueName: \"kubernetes.io/projected/4a797429-2125-4382-882c-c66a004f681c-kube-api-access-hfp77\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.419939 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.419910 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfp77\" (UniqueName: \"kubernetes.io/projected/4a797429-2125-4382-882c-c66a004f681c-kube-api-access-hfp77\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.420095 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.419959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a797429-2125-4382-882c-c66a004f681c-tls-cert\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.420095 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.419989 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4a797429-2125-4382-882c-c66a004f681c-oidc-ca\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.420559 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.420540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4a797429-2125-4382-882c-c66a004f681c-oidc-ca\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.422684 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.422662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4a797429-2125-4382-882c-c66a004f681c-tls-cert\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.428363 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.428344 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfp77\" (UniqueName: \"kubernetes.io/projected/4a797429-2125-4382-882c-c66a004f681c-kube-api-access-hfp77\") pod \"authorino-564d4cfdf9-b9nr2\" (UID: \"4a797429-2125-4382-882c-c66a004f681c\") " pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.550817 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.550734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" Jul 02 15:06:28.687938 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.687911 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-564d4cfdf9-b9nr2"] Jul 02 15:06:28.689715 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:06:28.689681 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a797429_2125_4382_882c_c66a004f681c.slice/crio-dd64bf9d04bd90e697291fd98cf11ec86505d2ad87b233f7b72102102075c269 WatchSource:0}: Error finding container dd64bf9d04bd90e697291fd98cf11ec86505d2ad87b233f7b72102102075c269: Status 404 returned error can't find the container with id dd64bf9d04bd90e697291fd98cf11ec86505d2ad87b233f7b72102102075c269 Jul 02 15:06:28.740095 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.740062 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:06:28.839206 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:28.839076 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:06:29.344111 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.344067 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" event={"ID":"4a797429-2125-4382-882c-c66a004f681c","Type":"ContainerStarted","Data":"f692ea7d4c662224d61e149524938ba19ea1ded65bfca7aca64bb856b5f87e43"} Jul 02 15:06:29.344734 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.344126 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" event={"ID":"4a797429-2125-4382-882c-c66a004f681c","Type":"ContainerStarted","Data":"dd64bf9d04bd90e697291fd98cf11ec86505d2ad87b233f7b72102102075c269"} Jul 02 15:06:29.363781 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.363675 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-564d4cfdf9-b9nr2" podStartSLOduration=0.992957573 podStartE2EDuration="1.363635394s" totalImagesPullingTime="370.677821ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:06:29.362236527 +0000 UTC m=+1096.699293291" watchObservedRunningTime="2026-07-02 15:06:29.363635394 +0000 UTC m=+1096.700692159" Jul 02 15:06:29.392393 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.392358 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74fcf49566-jmkz4"] Jul 02 15:06:29.392774 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.392571 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-74fcf49566-jmkz4" podUID="78001d32-282b-49ea-be29-b43a84447e25" containerName="authorino" containerID="cri-o://592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7" gracePeriod=30 Jul 02 15:06:29.654001 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.653974 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:06:29.733516 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.733478 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwrkx\" (UniqueName: \"kubernetes.io/projected/78001d32-282b-49ea-be29-b43a84447e25-kube-api-access-nwrkx\") pod \"78001d32-282b-49ea-be29-b43a84447e25\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " Jul 02 15:06:29.733516 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.733519 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78001d32-282b-49ea-be29-b43a84447e25-tls-cert\") pod \"78001d32-282b-49ea-be29-b43a84447e25\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " Jul 02 15:06:29.733784 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.733627 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/78001d32-282b-49ea-be29-b43a84447e25-oidc-ca\") pod \"78001d32-282b-49ea-be29-b43a84447e25\" (UID: \"78001d32-282b-49ea-be29-b43a84447e25\") " Jul 02 15:06:29.735839 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.735796 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78001d32-282b-49ea-be29-b43a84447e25-kube-api-access-nwrkx" (OuterVolumeSpecName: "kube-api-access-nwrkx") pod "78001d32-282b-49ea-be29-b43a84447e25" (UID: "78001d32-282b-49ea-be29-b43a84447e25"). InnerVolumeSpecName "kube-api-access-nwrkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:06:29.738186 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.738159 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78001d32-282b-49ea-be29-b43a84447e25-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "78001d32-282b-49ea-be29-b43a84447e25" (UID: "78001d32-282b-49ea-be29-b43a84447e25"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:06:29.743089 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.743065 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78001d32-282b-49ea-be29-b43a84447e25-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "78001d32-282b-49ea-be29-b43a84447e25" (UID: "78001d32-282b-49ea-be29-b43a84447e25"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 15:06:29.835071 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.835027 2559 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/78001d32-282b-49ea-be29-b43a84447e25-oidc-ca\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:06:29.835071 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.835065 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwrkx\" (UniqueName: \"kubernetes.io/projected/78001d32-282b-49ea-be29-b43a84447e25-kube-api-access-nwrkx\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:06:29.835071 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.835081 2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/78001d32-282b-49ea-be29-b43a84447e25-tls-cert\") on node \"ip-10-0-128-44.ec2.internal\" DevicePath \"\"" Jul 02 15:06:29.862510 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:29.862454 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:06:30.074019 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.073980 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:06:30.350703 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.350594 2559 generic.go:356] "Generic (PLEG): container finished" podID="78001d32-282b-49ea-be29-b43a84447e25" containerID="592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7" exitCode=0 Jul 02 15:06:30.350703 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.350644 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fcf49566-jmkz4" Jul 02 15:06:30.350703 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.350675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fcf49566-jmkz4" event={"ID":"78001d32-282b-49ea-be29-b43a84447e25","Type":"ContainerDied","Data":"592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7"} Jul 02 15:06:30.351272 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.350722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fcf49566-jmkz4" event={"ID":"78001d32-282b-49ea-be29-b43a84447e25","Type":"ContainerDied","Data":"e0a6705ccb912d22550e8acdc047cc5588c3a3a046f3dc4b921059cba49b9c18"} Jul 02 15:06:30.351272 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.350746 2559 scope.go:117] "RemoveContainer" containerID="592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7" Jul 02 15:06:30.363160 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.363137 2559 scope.go:117] "RemoveContainer" containerID="592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7" Jul 02 15:06:30.363454 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:06:30.363431 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7\": container with ID starting with 592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7 not found: ID does not exist" containerID="592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7" Jul 02 15:06:30.363517 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.363466 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7"} err="failed to get container status \"592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7\": rpc error: code = NotFound desc = could not find container \"592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7\": container with ID starting with 592b8a4b50dfecc41d481c15f47fa4bba3826a883784bb52aaa9c3d29d2e48b7 not found: ID does not exist" Jul 02 15:06:30.374282 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.374260 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74fcf49566-jmkz4"] Jul 02 15:06:30.377178 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:30.377157 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74fcf49566-jmkz4"] Jul 02 15:06:31.158338 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:31.158300 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78001d32-282b-49ea-be29-b43a84447e25" path="/var/lib/kubelet/pods/78001d32-282b-49ea-be29-b43a84447e25/volumes" Jul 02 15:06:35.376935 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:35.376902 2559 generic.go:356] "Generic (PLEG): container finished" podID="75973978-4a59-477a-897f-528ebb1bed58" containerID="a5f8df61bea63e7fd75bba489509720941468f4ff682e718694f1997b40194c1" exitCode=2 Jul 02 15:06:35.377341 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:35.376973 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" event={"ID":"75973978-4a59-477a-897f-528ebb1bed58","Type":"ContainerDied","Data":"a5f8df61bea63e7fd75bba489509720941468f4ff682e718694f1997b40194c1"} Jul 02 15:06:35.377341 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:35.377272 2559 scope.go:117] "RemoveContainer" containerID="a5f8df61bea63e7fd75bba489509720941468f4ff682e718694f1997b40194c1" Jul 02 15:06:35.629376 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:35.629294 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:06:36.383898 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:36.383860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" event={"ID":"75973978-4a59-477a-897f-528ebb1bed58","Type":"ContainerStarted","Data":"ce47a5dad580227748fd9016fe855fb570a0331ccb09df77307c57c9a90f1241"} Jul 02 15:06:36.384278 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:36.383932 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:06:47.390420 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:47.390390 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:06:53.019467 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:53.019426 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:06:53.078054 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:53.078024 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:06:57.399998 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:57.399959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:06:57.474453 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:06:57.474419 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:07:07.980678 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:07.980623 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564d4cfdf9-b9nr2_4a797429-2125-4382-882c-c66a004f681c/authorino/0.log" Jul 02 15:07:08.524803 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:08.524771 2559 generic.go:356] "Generic (PLEG): container finished" podID="75973978-4a59-477a-897f-528ebb1bed58" containerID="ce47a5dad580227748fd9016fe855fb570a0331ccb09df77307c57c9a90f1241" exitCode=2 Jul 02 15:07:08.524963 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:08.524841 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" event={"ID":"75973978-4a59-477a-897f-528ebb1bed58","Type":"ContainerDied","Data":"ce47a5dad580227748fd9016fe855fb570a0331ccb09df77307c57c9a90f1241"} Jul 02 15:07:08.524963 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:08.524923 2559 scope.go:117] "RemoveContainer" containerID="a5f8df61bea63e7fd75bba489509720941468f4ff682e718694f1997b40194c1" Jul 02 15:07:08.525169 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:08.525157 2559 scope.go:117] "RemoveContainer" containerID="ce47a5dad580227748fd9016fe855fb570a0331ccb09df77307c57c9a90f1241" Jul 02 15:07:08.525365 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:07:08.525347 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-w6qnp_openshift-ingress(75973978-4a59-477a-897f-528ebb1bed58)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" podUID="75973978-4a59-477a-897f-528ebb1bed58" Jul 02 15:07:12.804914 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:12.804885 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59f9dd4b66-82xv4_072dab6c-6893-42f6-bf73-cb57d68931bc/manager/0.log" Jul 02 15:07:12.916041 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:12.916007 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qctxp_03dc3076-8102-4d5f-be3a-3047ceba86c7/server/0.log" Jul 02 15:07:13.038419 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:13.038383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kn77n_3959b5ab-1448-423a-b58a-e58cb1fdefc5/manager/0.log" Jul 02 15:07:13.388800 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:13.388767 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-nd24j_11c305e3-f541-47e4-a077-e10d0600f3c0/copy-manifests/0.log" Jul 02 15:07:13.407642 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:13.407608 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-nd24j_11c305e3-f541-47e4-a077-e10d0600f3c0/manager/0.log" Jul 02 15:07:14.784663 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:14.784611 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564d4cfdf9-b9nr2_4a797429-2125-4382-882c-c66a004f681c/authorino/0.log" Jul 02 15:07:15.114858 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:15.114789 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wfsjd_2d3edd8d-ae90-4df7-82b0-1777dd83ebac/kuadrant-console-plugin/0.log" Jul 02 15:07:16.304936 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:16.304905 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b948f4-nxwnv_61932201-db8c-4f90-9476-5e0f752a0b09/kube-auth-proxy/0.log" Jul 02 15:07:16.522785 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:16.522753 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-4pzzl_f25a3ce6-5066-4975-a3bf-4538ea645a81/payload-pre-processing/0.log" Jul 02 15:07:16.650680 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:16.650577 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-w6qnp_75973978-4a59-477a-897f-528ebb1bed58/payload-processing/1.log" Jul 02 15:07:17.107526 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:17.107488 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nlgt5_332b6de7-2e3c-4a97-8b77-46737b2cc004/main/0.log" Jul 02 15:07:17.388759 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:17.388674 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:07:17.389119 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:17.389045 2559 scope.go:117] "RemoveContainer" containerID="ce47a5dad580227748fd9016fe855fb570a0331ccb09df77307c57c9a90f1241" Jul 02 15:07:17.389247 ip-10-0-128-44 kubenswrapper[2559]: E0702 15:07:17.389227 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7bbcb654f4-w6qnp_openshift-ingress(75973978-4a59-477a-897f-528ebb1bed58)\"" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" podUID="75973978-4a59-477a-897f-528ebb1bed58" Jul 02 15:07:17.559941 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:17.559906 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-k9rqp_e17690b0-25ba-4124-8f0f-6aa284e90e1d/main/0.log" Jul 02 15:07:21.288165 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:21.288127 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:07:21.288533 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:21.288479 2559 scope.go:117] "RemoveContainer" containerID="ce47a5dad580227748fd9016fe855fb570a0331ccb09df77307c57c9a90f1241" Jul 02 15:07:21.520307 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:21.520250 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:07:21.579821 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:21.579748 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" event={"ID":"75973978-4a59-477a-897f-528ebb1bed58","Type":"ContainerStarted","Data":"6b29994b4d40dbd351fb2dc2ece4ed0a20863e8d791145ec9f79896bf4f83df5"} Jul 02 15:07:21.579982 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:21.579963 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:07:21.607424 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:21.607393 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" limit=1024 Jul 02 15:07:24.443265 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:24.443217 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4w8l6_d26531ce-4e76-43a8-aaf0-8ec9d45d0ddd/global-pull-secret-syncer/0.log" Jul 02 15:07:24.582169 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:24.582140 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bqp6z_87346d39-0870-4761-97a0-4624d223b352/konnectivity-agent/0.log" Jul 02 15:07:24.657628 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:24.657588 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-44.ec2.internal_0370d9c46c9da9e1f4e1c6074d7c2819/haproxy/0.log" Jul 02 15:07:29.991898 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:29.991870 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564d4cfdf9-b9nr2_4a797429-2125-4382-882c-c66a004f681c/authorino/0.log" Jul 02 15:07:30.093184 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:30.093159 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-wfsjd_2d3edd8d-ae90-4df7-82b0-1777dd83ebac/kuadrant-console-plugin/0.log" Jul 02 15:07:32.446179 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:32.446148 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbxnd_b82fa703-d3e3-40eb-9f0a-6b33a407256c/node-exporter/0.log" Jul 02 15:07:32.466998 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:32.466973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbxnd_b82fa703-d3e3-40eb-9f0a-6b33a407256c/kube-rbac-proxy/0.log" Jul 02 15:07:32.487867 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:32.487842 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbxnd_b82fa703-d3e3-40eb-9f0a-6b33a407256c/init-textfile/0.log" Jul 02 15:07:32.586757 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:32.586734 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-w6qnp" Jul 02 15:07:34.391933 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.391866 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh"] Jul 02 15:07:34.392260 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.392177 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78001d32-282b-49ea-be29-b43a84447e25" containerName="authorino" Jul 02 15:07:34.392260 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.392188 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="78001d32-282b-49ea-be29-b43a84447e25" containerName="authorino" Jul 02 15:07:34.392260 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.392252 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="78001d32-282b-49ea-be29-b43a84447e25" containerName="authorino" Jul 02 15:07:34.395302 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.395287 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.398265 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.398243 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4j7n\"/\"kube-root-ca.crt\"" Jul 02 15:07:34.399800 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.399780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4j7n\"/\"openshift-service-ca.crt\"" Jul 02 15:07:34.399919 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.399800 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t4j7n\"/\"default-dockercfg-fj28k\"" Jul 02 15:07:34.403973 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.403949 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh"] Jul 02 15:07:34.458444 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.458418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq55v\" (UniqueName: \"kubernetes.io/projected/53df0833-06a7-44cb-a9ce-98c874000026-kube-api-access-dq55v\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.458594 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.458471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-sys\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.458594 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.458492 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-podres\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.458594 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.458560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-proc\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.458798 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.458603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-lib-modules\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.458948 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.458934 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-4p6bq_d8c73011-8f84-4c1d-b6e5-9eca8b57eb13/networking-console-plugin/0.log" Jul 02 15:07:34.559106 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-podres\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.559231 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-proc\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.559231 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-lib-modules\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.559231 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559182 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq55v\" (UniqueName: \"kubernetes.io/projected/53df0833-06a7-44cb-a9ce-98c874000026-kube-api-access-dq55v\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.559231 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559209 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-proc\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.559382 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-sys\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.559382 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559251 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-podres\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.559382 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-sys\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.559382 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.559321 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53df0833-06a7-44cb-a9ce-98c874000026-lib-modules\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.567306 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.567277 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq55v\" (UniqueName: \"kubernetes.io/projected/53df0833-06a7-44cb-a9ce-98c874000026-kube-api-access-dq55v\") pod \"perf-node-gather-daemonset-7n6kh\" (UID: \"53df0833-06a7-44cb-a9ce-98c874000026\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.705858 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.705797 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:34.829366 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:34.829335 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh"] Jul 02 15:07:34.831001 ip-10-0-128-44 kubenswrapper[2559]: W0702 15:07:34.830977 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod53df0833_06a7_44cb_a9ce_98c874000026.slice/crio-8b630478851d84b28b1e55f6ce509f92cafa902fb146f7b2c2d40ba452a17d75 WatchSource:0}: Error finding container 8b630478851d84b28b1e55f6ce509f92cafa902fb146f7b2c2d40ba452a17d75: Status 404 returned error can't find the container with id 8b630478851d84b28b1e55f6ce509f92cafa902fb146f7b2c2d40ba452a17d75 Jul 02 15:07:35.642163 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:35.642130 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" event={"ID":"53df0833-06a7-44cb-a9ce-98c874000026","Type":"ContainerStarted","Data":"c1f51aaedbca7e450002a395bfdb2dc6ac03b004c97ee1e88ccdda592a2b6d5b"} Jul 02 15:07:35.642537 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:35.642178 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" event={"ID":"53df0833-06a7-44cb-a9ce-98c874000026","Type":"ContainerStarted","Data":"8b630478851d84b28b1e55f6ce509f92cafa902fb146f7b2c2d40ba452a17d75"} Jul 02 15:07:35.642537 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:35.642253 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:35.659100 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:35.659057 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" podStartSLOduration=1.659045452 podStartE2EDuration="1.659045452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:07:35.658033868 +0000 UTC m=+1162.995090632" watchObservedRunningTime="2026-07-02 15:07:35.659045452 +0000 UTC m=+1162.996102216" Jul 02 15:07:37.307051 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:37.307020 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tb4tg_e707e3de-1d9e-4adf-998b-64e3cc8cf201/dns/0.log" Jul 02 15:07:37.327074 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:37.327041 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tb4tg_e707e3de-1d9e-4adf-998b-64e3cc8cf201/kube-rbac-proxy/0.log" Jul 02 15:07:37.418293 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:37.418257 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-frcsz_db06ba71-e44a-45f1-b291-7e8f944ce68d/dns-node-resolver/0.log" Jul 02 15:07:38.032059 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:38.032030 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wrg9c_c426b758-6486-4602-8009-c551664c6a74/node-ca/0.log" Jul 02 15:07:39.095883 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:39.095853 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b948f4-nxwnv_61932201-db8c-4f90-9476-5e0f752a0b09/kube-auth-proxy/0.log" Jul 02 15:07:39.146665 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:39.146630 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-4pzzl_f25a3ce6-5066-4975-a3bf-4538ea645a81/payload-pre-processing/0.log" Jul 02 15:07:39.170384 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:39.170360 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-w6qnp_75973978-4a59-477a-897f-528ebb1bed58/payload-processing/2.log" Jul 02 15:07:39.171361 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:39.171340 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-w6qnp_75973978-4a59-477a-897f-528ebb1bed58/payload-processing/1.log" Jul 02 15:07:39.819662 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:39.819618 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kvp9z_1e920e3e-fe66-4a55-a5ed-c0714de82f53/serve-healthcheck-canary/0.log" Jul 02 15:07:40.458975 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:40.458943 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2fs9p_e05244e3-4287-4fb6-941c-bf2218fd57ca/kube-rbac-proxy/0.log" Jul 02 15:07:40.484473 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:40.484446 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2fs9p_e05244e3-4287-4fb6-941c-bf2218fd57ca/exporter/0.log" Jul 02 15:07:40.506711 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:40.506688 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2fs9p_e05244e3-4287-4fb6-941c-bf2218fd57ca/extractor/0.log" Jul 02 15:07:41.655840 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:41.655814 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-7n6kh" Jul 02 15:07:42.910036 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:42.910001 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59f9dd4b66-82xv4_072dab6c-6893-42f6-bf73-cb57d68931bc/manager/0.log" Jul 02 15:07:42.934049 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:42.934025 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qctxp_03dc3076-8102-4d5f-be3a-3047ceba86c7/server/0.log" Jul 02 15:07:43.004085 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:43.004057 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kn77n_3959b5ab-1448-423a-b58a-e58cb1fdefc5/manager/0.log" Jul 02 15:07:43.172673 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:43.172576 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-nd24j_11c305e3-f541-47e4-a077-e10d0600f3c0/manager/0.log" Jul 02 15:07:43.192964 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:43.192936 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-nd24j_11c305e3-f541-47e4-a077-e10d0600f3c0/copy-manifests/0.log" Jul 02 15:07:44.791852 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:44.791819 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bdfcfdbc4-9j7z2_49b8d657-0906-4084-8420-a9433131a90a/manager/0.log" Jul 02 15:07:45.512899 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:45.512874 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b948f4-nxwnv_61932201-db8c-4f90-9476-5e0f752a0b09/kube-auth-proxy/0.log" Jul 02 15:07:45.545498 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:45.545463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-4pzzl_f25a3ce6-5066-4975-a3bf-4538ea645a81/payload-pre-processing/0.log" Jul 02 15:07:45.561445 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:45.561419 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-w6qnp_75973978-4a59-477a-897f-528ebb1bed58/payload-processing/2.log" Jul 02 15:07:45.562582 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:45.562564 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-w6qnp_75973978-4a59-477a-897f-528ebb1bed58/payload-processing/1.log" Jul 02 15:07:46.745321 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:46.745290 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-685b948f4-nxwnv_61932201-db8c-4f90-9476-5e0f752a0b09/kube-auth-proxy/0.log" Jul 02 15:07:46.777178 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:46.777149 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-4pzzl_f25a3ce6-5066-4975-a3bf-4538ea645a81/payload-pre-processing/0.log" Jul 02 15:07:46.790974 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:46.790946 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-w6qnp_75973978-4a59-477a-897f-528ebb1bed58/payload-processing/2.log" Jul 02 15:07:46.792200 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:46.792179 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-w6qnp_75973978-4a59-477a-897f-528ebb1bed58/payload-processing/1.log" Jul 02 15:07:51.248340 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.248308 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg7lv_6bd50344-c877-4066-8fe6-9e38645f3839/kube-multus-additional-cni-plugins/0.log" Jul 02 15:07:51.268964 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.268941 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg7lv_6bd50344-c877-4066-8fe6-9e38645f3839/egress-router-binary-copy/0.log" Jul 02 15:07:51.288694 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.288674 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg7lv_6bd50344-c877-4066-8fe6-9e38645f3839/cni-plugins/0.log" Jul 02 15:07:51.310244 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.310222 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg7lv_6bd50344-c877-4066-8fe6-9e38645f3839/bond-cni-plugin/0.log" Jul 02 15:07:51.328592 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.328575 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg7lv_6bd50344-c877-4066-8fe6-9e38645f3839/routeoverride-cni/0.log" Jul 02 15:07:51.356669 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.356630 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg7lv_6bd50344-c877-4066-8fe6-9e38645f3839/whereabouts-cni-bincopy/0.log" Jul 02 15:07:51.375310 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.375287 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kg7lv_6bd50344-c877-4066-8fe6-9e38645f3839/whereabouts-cni/0.log" Jul 02 15:07:51.760273 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.760242 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q8k67_ef3c9901-8765-4e2f-8304-0f82b0990fe6/kube-multus/0.log" Jul 02 15:07:51.831446 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.831407 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n6vnp_035ab302-5ed4-4e18-9962-36620adfebde/network-metrics-daemon/0.log" Jul 02 15:07:51.851504 ip-10-0-128-44 kubenswrapper[2559]: I0702 15:07:51.851480 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-n6vnp_035ab302-5ed4-4e18-9962-36620adfebde/kube-rbac-proxy/0.log"