Jul 24 03:17:56.320567 ip-10-0-142-95 systemd[1]: Starting Kubernetes Kubelet... Jul 24 03:17:56.660261 ip-10-0-142-95 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:17:56.660261 ip-10-0-142-95 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 03:17:56.660261 ip-10-0-142-95 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:17:56.660261 ip-10-0-142-95 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 03:17:56.660261 ip-10-0-142-95 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 03:17:56.662341 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.662241 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 03:17:56.665558 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665542 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:17:56.665558 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665558 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665562 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665566 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665570 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665573 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665576 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665578 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665581 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665584 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665586 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665589 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665591 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665599 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665602 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665605 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665607 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665610 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665614 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665618 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:17:56.665622 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665621 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665624 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665627 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665631 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665634 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665636 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665639 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665641 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665644 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665646 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665649 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665651 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665654 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665656 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665658 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665661 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665663 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665665 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665668 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665671 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:17:56.666080 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665675 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665679 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665681 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665684 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665687 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665689 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665692 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665695 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665697 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665701 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665703 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665706 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665709 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665711 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665714 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665716 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665719 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665721 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665724 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665726 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665728 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:17:56.666610 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665731 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665733 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665735 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665739 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665743 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665745 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665748 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665750 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665753 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665757 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665760 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665763 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665765 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665768 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665770 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665773 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665775 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665778 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665781 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:17:56.667153 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665783 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665786 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665788 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665790 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665793 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665796 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665798 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665801 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665803 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665806 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665808 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665810 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665813 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665815 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665818 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665820 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665822 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665825 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.665827 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666545 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:17:56.667628 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666552 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666555 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666558 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666561 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666564 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666567 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666570 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666572 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666575 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666578 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666581 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666584 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666586 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666589 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666591 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666594 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666597 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666600 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666602 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:17:56.668152 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666605 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666607 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666610 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666613 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666616 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666619 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666621 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666624 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666626 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666629 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666631 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666633 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666636 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666639 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666641 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666644 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666646 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666648 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666652 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666654 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:17:56.668641 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666657 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666659 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666661 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666664 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666667 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666670 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666672 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666676 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666679 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666682 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666684 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666687 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666690 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666693 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666695 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666697 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666700 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666702 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666705 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666707 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:17:56.669172 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666710 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666712 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666715 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666717 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666719 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666722 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666724 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666727 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666729 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666731 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666734 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666739 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666743 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666746 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666748 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666752 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666755 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666758 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666761 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666764 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:17:56.669682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666766 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666769 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666771 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666774 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666776 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666779 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666781 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666785 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666789 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666791 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666794 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666797 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666800 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666803 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666806 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666808 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666811 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666813 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.666816 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667207 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:17:56.670181 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667212 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667215 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667218 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667221 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667223 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667226 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667228 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667231 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667234 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667236 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667239 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667242 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667244 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667247 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667250 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667252 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667255 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667258 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667261 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667264 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:17:56.670682 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667266 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667269 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667271 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667289 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667292 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667294 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667297 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667300 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667302 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667305 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667307 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667310 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667313 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667315 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667318 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667320 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667325 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667327 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667330 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:17:56.671167 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667333 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667336 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667339 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667341 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667344 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667346 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667349 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667351 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667354 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667357 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667359 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667362 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667364 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667367 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667369 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667372 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667375 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667377 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667380 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667382 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:17:56.671642 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667385 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667387 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667389 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667391 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667394 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667396 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667399 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667402 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667405 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667409 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667413 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667415 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667418 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667420 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667423 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667425 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667428 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667431 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667433 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:17:56.672118 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667437 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667440 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667443 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667446 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667449 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667451 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667454 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667456 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667459 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667461 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667464 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667466 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667469 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667471 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667473 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667476 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667478 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667481 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667483 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.667486 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667559 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 03:17:56.672601 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667566 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667573 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667580 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667588 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667594 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667603 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667608 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667612 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667615 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667618 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667621 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667624 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667627 2559 flags.go:64] FLAG: --cgroup-root="" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667630 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667633 2559 flags.go:64] FLAG: --client-ca-file="" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667637 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667639 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667644 2559 flags.go:64] FLAG: --cluster-domain="" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667647 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667650 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667653 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667656 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667660 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 03:17:56.673104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667663 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667666 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667670 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667673 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667676 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667679 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667682 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667684 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667688 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667691 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667694 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667696 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667699 2559 flags.go:64] FLAG: --enable-server="true" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667703 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667710 2559 flags.go:64] FLAG: --event-burst="100" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667713 2559 flags.go:64] FLAG: --event-qps="50" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667716 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667719 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667722 2559 flags.go:64] FLAG: --eviction-hard="" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667726 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667729 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667732 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667734 2559 flags.go:64] FLAG: --eviction-soft="" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667737 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667740 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 03:17:56.673666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667743 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667746 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667749 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667752 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667755 2559 flags.go:64] FLAG: --feature-gates="" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667758 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667761 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667764 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667767 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667770 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667798 2559 flags.go:64] FLAG: --help="false" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667803 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-142-95.ec2.internal" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667806 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667810 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667813 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667816 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667819 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667822 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667825 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667827 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667831 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667835 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667839 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667842 2559 flags.go:64] FLAG: --kube-reserved="" Jul 24 03:17:56.674381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667844 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667847 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667850 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667853 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667856 2559 flags.go:64] FLAG: --lock-file="" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667858 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667861 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667864 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667869 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667872 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667874 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667877 2559 flags.go:64] FLAG: --logging-format="text" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667879 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667883 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667885 2559 flags.go:64] FLAG: --manifest-url="" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667888 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667892 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667895 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667899 2559 flags.go:64] FLAG: --max-pods="110" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667902 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667904 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667907 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667910 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667913 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667916 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 03:17:56.675005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667918 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667925 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667928 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667931 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667936 2559 flags.go:64] FLAG: --pod-cidr="" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667939 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667945 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667948 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667951 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667954 2559 flags.go:64] FLAG: --port="10250" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667957 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667959 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0007dabeea7d4510d" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667962 2559 flags.go:64] FLAG: --qos-reserved="" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667965 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667968 2559 flags.go:64] FLAG: --register-node="true" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667971 2559 flags.go:64] FLAG: --register-with-taints="" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667974 2559 flags.go:64] FLAG: --registry-burst="10" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667977 2559 flags.go:64] FLAG: --registry-qps="5" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667980 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667984 2559 flags.go:64] FLAG: --reserved-memory="" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667988 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667991 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667993 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667996 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.667999 2559 flags.go:64] FLAG: --runonce="false" Jul 24 03:17:56.675637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668002 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668005 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668007 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668010 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668013 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668016 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668019 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668022 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668025 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668028 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668031 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668033 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668037 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668041 2559 flags.go:64] FLAG: --system-cgroups="" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668043 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668048 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668051 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668054 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668058 2559 flags.go:64] FLAG: --tls-min-version="" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668060 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668063 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668065 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668068 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668071 2559 flags.go:64] FLAG: --v="2" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668075 2559 flags.go:64] FLAG: --version="false" Jul 24 03:17:56.676249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668079 2559 flags.go:64] FLAG: --vmodule="" Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668084 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668088 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668201 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668206 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668209 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668211 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668214 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668216 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668219 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668221 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668224 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668227 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668229 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668232 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668235 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668237 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668240 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668242 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668248 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:17:56.676867 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668251 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668254 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668256 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668259 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668261 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668264 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668267 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668269 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668285 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668288 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668290 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668293 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668296 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668300 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668302 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668305 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668308 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668310 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668313 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668315 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:17:56.677376 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668317 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668320 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668322 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668325 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668327 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668330 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668332 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668335 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668337 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668340 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668342 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668346 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668349 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668351 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668357 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668360 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668363 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668365 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668368 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668370 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:17:56.677983 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668372 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668375 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668377 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668380 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668382 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668388 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668390 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668393 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668395 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668398 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668400 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668403 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668405 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668407 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668410 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668413 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668415 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668418 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668421 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:17:56.678535 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668425 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668429 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668432 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668435 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668439 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668442 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668445 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668447 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668450 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668453 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668455 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668458 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668460 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668463 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668465 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668468 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668471 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668475 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668480 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:17:56.679009 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668483 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668485 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668487 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.668490 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.668977 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.676150 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.676167 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.676185 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.676191 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676256 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676261 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676265 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676268 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676288 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676292 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:17:56.679554 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676295 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676298 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676301 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676304 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676307 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676310 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676313 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676317 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676319 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676322 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676324 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676327 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676329 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676332 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676334 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676337 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676340 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676342 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676345 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676347 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:17:56.679921 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676350 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676352 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676355 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676366 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676368 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676371 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676373 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676376 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676379 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676381 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676384 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676386 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676389 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676391 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676393 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676396 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676399 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676401 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676406 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:17:56.680441 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676409 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676412 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676415 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676419 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676422 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676425 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676427 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676430 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676433 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676436 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676439 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676442 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676444 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676447 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676450 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676452 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676455 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676463 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676466 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676468 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:17:56.680906 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676471 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676474 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676477 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676479 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676482 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676484 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676487 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676491 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676494 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676497 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676500 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676503 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676506 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676509 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676511 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676514 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676517 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676525 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676528 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:17:56.681401 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676531 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676533 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676536 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676539 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676541 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676544 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676546 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676548 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676551 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676553 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676556 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676563 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676566 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676569 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:17:56.681903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676571 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.676577 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676725 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676730 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676733 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676736 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676738 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676741 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676744 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676746 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676749 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676751 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676754 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676756 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 03:17:56.682260 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676759 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676762 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676764 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676767 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676769 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676771 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676774 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676776 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676779 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676781 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676783 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676786 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676788 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676791 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676793 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676796 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676803 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676806 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676808 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 03:17:56.682677 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676811 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676815 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676818 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676820 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676823 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676826 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676829 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676831 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676834 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676837 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676839 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676842 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676844 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676847 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676849 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676865 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676869 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676873 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676876 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 03:17:56.683130 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676879 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676881 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676884 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676887 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676889 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676892 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676894 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676896 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676899 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676901 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676904 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676911 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676914 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676917 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676919 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676922 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676924 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676926 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676929 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676931 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 03:17:56.683840 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676934 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676936 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676938 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676941 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676943 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676945 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676948 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676950 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676953 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676955 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676957 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676960 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676962 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676965 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676967 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676970 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676972 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676974 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676976 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676979 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 03:17:56.684646 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676981 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676984 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676986 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.676989 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.677000 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.677003 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.677005 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.677007 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:56.677010 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.677015 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.677159 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.679131 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.680301 2559 server.go:1019] "Starting client certificate rotation" Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.680402 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 03:17:56.685390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.680455 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 03:17:56.685776 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.682552 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 03:17:56.687958 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.687937 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 03:17:56.696406 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.696385 2559 log.go:25] "Validated CRI v1 runtime API" Jul 24 03:17:56.698377 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.698362 2559 log.go:25] "Validated CRI v1 image API" Jul 24 03:17:56.699173 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.699157 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 03:17:56.701198 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.701178 2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e8e8eeab-a10e-4c6f-8d50-0207c7b9a2e5:/dev/nvme0n1p3 f1a10e6c-2001-46d5-b063-767690dd7652:/dev/nvme0n1p4] Jul 24 03:17:56.701245 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.701199 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 03:17:56.706151 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.706045 2559 manager.go:216] Machine: {Timestamp:2026-07-24 03:17:56.704878724 +0000 UTC m=+0.279528662 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115695 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2010ddacc5ce09df935002deb49bc9 SystemUUID:ec2010dd-acc5-ce09-df93-5002deb49bc9 BootID:3b8cbb35-ba00-4515-8e91-bb2fb7dacda1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:27:9b:a3:71:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:27:9b:a3:71:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:f9:8d:0e:10:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 03:17:56.706151 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.706146 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 03:17:56.706261 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.706228 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 03:17:56.708876 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.708845 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 03:17:56.709032 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.708880 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-95.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 03:17:56.709478 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.709468 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 03:17:56.709518 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.709481 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 03:17:56.709518 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.709488 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 03:17:56.710028 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.710018 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 03:17:56.711089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.711077 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 03:17:56.711260 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.711243 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 03:17:56.712656 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.712645 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 24 03:17:56.712774 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.712764 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 03:17:56.712811 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.712793 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 24 03:17:56.712811 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.712805 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 03:17:56.712865 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.712817 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 03:17:56.712865 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.712826 2559 kubelet.go:398] "Adding apiserver pod source" Jul 24 03:17:56.712865 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.712836 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 03:17:56.713312 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.713300 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 03:17:56.713387 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.713320 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 03:17:56.715271 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.715253 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 03:17:56.717199 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.717183 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 03:17:56.717298 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.717222 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 03:17:56.718584 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718569 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 03:17:56.718657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718589 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 03:17:56.718657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718599 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 03:17:56.718657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718607 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 03:17:56.718657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718619 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 03:17:56.718657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718627 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 03:17:56.718657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718638 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 03:17:56.718657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718646 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 03:17:56.718657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718655 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 03:17:56.718896 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718664 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 03:17:56.718896 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718676 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 03:17:56.718896 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.718685 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 03:17:56.719321 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.719307 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 03:17:56.719395 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.719338 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 03:17:56.722543 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.722528 2559 server.go:1268] "Started kubelet" Jul 24 03:17:56.722633 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.722589 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 03:17:56.725056 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.724869 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 03:17:56.725164 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.725088 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 03:17:56.725784 ip-10-0-142-95 systemd[1]: Started Kubernetes Kubelet. Jul 24 03:17:56.726008 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.725960 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 03:17:56.726077 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.726061 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-95.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 03:17:56.726471 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.726403 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 03:17:56.727156 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.727125 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 03:17:56.728700 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.728681 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 24 03:17:56.730369 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.729471 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-95.ec2.internal.18c51b82fcc157f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-95.ec2.internal,UID:ip-10-0-142-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-95.ec2.internal,},FirstTimestamp:2026-07-24 03:17:56.72249752 +0000 UTC m=+0.297147443,LastTimestamp:2026-07-24 03:17:56.72249752 +0000 UTC m=+0.297147443,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-95.ec2.internal,}" Jul 24 03:17:56.730545 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.730522 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 03:17:56.733799 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.733782 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 03:17:56.733891 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.733800 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 03:17:56.733950 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.733896 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:56.734331 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734312 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 03:17:56.734331 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734316 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 03:17:56.734445 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734338 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 03:17:56.734489 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734465 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 24 03:17:56.734489 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734474 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 24 03:17:56.734615 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734597 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 03:17:56.734663 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734617 2559 factory.go:55] Registering systemd factory Jul 24 03:17:56.734663 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734626 2559 factory.go:223] Registration of the systemd container factory successfully Jul 24 03:17:56.734881 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734864 2559 factory.go:153] Registering CRI-O factory Jul 24 03:17:56.734881 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734881 2559 factory.go:223] Registration of the crio container factory successfully Jul 24 03:17:56.735033 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734900 2559 factory.go:103] Registering Raw factory Jul 24 03:17:56.735033 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.734912 2559 manager.go:1196] Started watching for new ooms in manager Jul 24 03:17:56.735366 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.735350 2559 manager.go:349] Starting recovery of all containers Jul 24 03:17:56.735889 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.735866 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 03:17:56.737658 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.737631 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-95.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 03:17:56.745038 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.745016 2559 manager.go:354] Recovery completed Jul 24 03:17:56.749607 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.749592 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:17:56.751767 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.751741 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:17:56.751839 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.751782 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:17:56.751839 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.751797 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:17:56.752340 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.752327 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 03:17:56.752340 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.752337 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 03:17:56.752463 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.752354 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 24 03:17:56.752463 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.752359 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:17:56.753476 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.753459 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:17:56.753555 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.753491 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:17:56.753555 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.753505 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:17:56.753667 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.753599 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-95.ec2.internal.18c51b82fe7fecda default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-95.ec2.internal,UID:ip-10-0-142-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-95.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-95.ec2.internal,},FirstTimestamp:2026-07-24 03:17:56.751764698 +0000 UTC m=+0.326414622,LastTimestamp:2026-07-24 03:17:56.751764698 +0000 UTC m=+0.326414622,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-95.ec2.internal,}" Jul 24 03:17:56.754300 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.754287 2559 policy_none.go:49] "None policy: Start" Jul 24 03:17:56.754366 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.754304 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 03:17:56.754366 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.754315 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 03:17:56.755241 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.755230 2559 policy_none.go:47] "Start" Jul 24 03:17:56.760686 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.760647 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pctvc" Jul 24 03:17:56.764499 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.764425 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-95.ec2.internal.18c51b82fe804c2d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-95.ec2.internal,UID:ip-10-0-142-95.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-95.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-95.ec2.internal,},FirstTimestamp:2026-07-24 03:17:56.751789101 +0000 UTC m=+0.326439026,LastTimestamp:2026-07-24 03:17:56.751789101 +0000 UTC m=+0.326439026,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-95.ec2.internal,}" Jul 24 03:17:56.768365 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.768339 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pctvc" Jul 24 03:17:56.803907 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.803717 2559 manager.go:337] "Starting Device Plugin manager" Jul 24 03:17:56.803996 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.803936 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 03:17:56.803996 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.803949 2559 server.go:87] "Starting device plugin registration server" Jul 24 03:17:56.804225 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.804213 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 03:17:56.804260 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.804229 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 03:17:56.804350 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.804335 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 03:17:56.804419 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.804407 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 03:17:56.804419 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.804417 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 03:17:56.804991 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.804968 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 03:17:56.805075 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.805020 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:56.897580 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.897545 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 03:17:56.898841 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.898827 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 03:17:56.898908 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.898864 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 03:17:56.898908 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.898891 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 03:17:56.898978 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.898926 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 03:17:56.901100 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.901081 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:17:56.905160 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.905143 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:17:56.905961 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.905943 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:17:56.906044 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.905984 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:17:56.906044 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.906000 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:17:56.906044 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.906023 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-95.ec2.internal" Jul 24 03:17:56.917314 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.917252 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-95.ec2.internal" Jul 24 03:17:56.917314 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.917290 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-95.ec2.internal\": node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:56.938871 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:56.938848 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:56.999923 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.999884 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal"] Jul 24 03:17:57.000078 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:56.999983 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:17:57.002458 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.002441 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:17:57.002560 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.002473 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:17:57.002560 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.002489 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:17:57.003891 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.003878 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:17:57.003996 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.003980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.004038 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.004014 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:17:57.004624 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.004608 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:17:57.004684 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.004640 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:17:57.004684 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.004650 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:17:57.004744 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.004608 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:17:57.004744 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.004709 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:17:57.004744 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.004722 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:17:57.006222 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.006209 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.006302 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.006235 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 03:17:57.006973 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.006959 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientMemory" Jul 24 03:17:57.007040 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.006985 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 03:17:57.007040 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.006995 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeHasSufficientPID" Jul 24 03:17:57.032055 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.032029 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-95.ec2.internal\" not found" node="ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.036422 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.036378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07c01ed83c1ca76d7a45565c7e1bd3b3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-95.ec2.internal\" (UID: \"07c01ed83c1ca76d7a45565c7e1bd3b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.036504 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.036429 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f159a86c6b4d5f653e8cf75ff9bcb623-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f159a86c6b4d5f653e8cf75ff9bcb623\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.036504 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.036406 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-95.ec2.internal\" not found" node="ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.036504 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.036447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f159a86c6b4d5f653e8cf75ff9bcb623-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f159a86c6b4d5f653e8cf75ff9bcb623\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.039460 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.039445 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:57.136982 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.136938 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f159a86c6b4d5f653e8cf75ff9bcb623-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f159a86c6b4d5f653e8cf75ff9bcb623\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.136982 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.136980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07c01ed83c1ca76d7a45565c7e1bd3b3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-95.ec2.internal\" (UID: \"07c01ed83c1ca76d7a45565c7e1bd3b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.137175 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.137000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f159a86c6b4d5f653e8cf75ff9bcb623-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f159a86c6b4d5f653e8cf75ff9bcb623\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.137175 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.137037 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f159a86c6b4d5f653e8cf75ff9bcb623-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f159a86c6b4d5f653e8cf75ff9bcb623\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.137175 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.137053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/07c01ed83c1ca76d7a45565c7e1bd3b3-config\") pod \"kube-apiserver-proxy-ip-10-0-142-95.ec2.internal\" (UID: \"07c01ed83c1ca76d7a45565c7e1bd3b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.137175 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.137053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f159a86c6b4d5f653e8cf75ff9bcb623-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal\" (UID: \"f159a86c6b4d5f653e8cf75ff9bcb623\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.140058 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.140037 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:57.240861 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.240834 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:57.334101 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.334061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.338893 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.338878 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.341035 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.341018 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:57.441147 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.441097 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:57.541764 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.541677 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-95.ec2.internal\" not found" Jul 24 03:17:57.551951 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.551920 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:17:57.630804 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.630782 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:17:57.634528 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.634503 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.646448 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.646426 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 03:17:57.647901 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.647886 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" Jul 24 03:17:57.656207 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.656192 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 03:17:57.680377 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.680351 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 03:17:57.680783 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.680497 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 03:17:57.680783 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.680523 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 03:17:57.680783 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.680523 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 03:17:57.713692 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.713665 2559 apiserver.go:52] "Watching apiserver" Jul 24 03:17:57.733017 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.732625 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 03:17:57.733752 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.733719 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg","openshift-cluster-node-tuning-operator/tuned-vqnlh","openshift-dns/node-resolver-l8k4p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal","openshift-multus/multus-qx54p","openshift-network-diagnostics/network-check-target-ktlcb","openshift-network-operator/iptables-alerter-x5xms","kube-system/global-pull-secret-syncer-b25hj","kube-system/konnectivity-agent-k2bwb","openshift-image-registry/node-ca-2gfsv","openshift-multus/multus-additional-cni-plugins-xx9vb","openshift-multus/network-metrics-daemon-qtwg5","openshift-ovn-kubernetes/ovnkube-node-2bqmc","kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal"] Jul 24 03:17:57.733949 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.733932 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 03:17:57.735158 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.735138 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:17:57.736242 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.736226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.737537 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.737520 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 03:17:57.737537 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.737530 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rvhd9\"" Jul 24 03:17:57.737653 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.737530 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 03:17:57.737995 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.737980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.738445 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.738424 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-znqwz\"" Jul 24 03:17:57.738525 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.738446 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 03:17:57.738525 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.738446 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:17:57.739311 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.739296 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.739370 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.739298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c0d2909-d462-42a6-b748-4bfa4d3016b3-agent-certs\") pod \"konnectivity-agent-k2bwb\" (UID: \"3c0d2909-d462-42a6-b748-4bfa4d3016b3\") " pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:17:57.739419 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.739401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c0d2909-d462-42a6-b748-4bfa4d3016b3-konnectivity-ca\") pod \"konnectivity-agent-k2bwb\" (UID: \"3c0d2909-d462-42a6-b748-4bfa4d3016b3\") " pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:17:57.740502 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.740489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.741588 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.741571 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:17:57.741674 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.741647 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:17:57.742505 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.742479 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 03:17:57.742603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.742588 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 03:17:57.742673 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.742602 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 03:17:57.742673 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.742605 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 03:17:57.742745 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.742691 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.742745 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.742699 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 03:17:57.742815 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.742788 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:17:57.743581 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743559 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 03:17:57.743581 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743567 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 03:17:57.743730 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743607 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-clwxh\"" Jul 24 03:17:57.743730 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743674 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 03:17:57.743730 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743611 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 03:17:57.743730 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743689 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4t5w2\"" Jul 24 03:17:57.743730 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743710 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 03:17:57.743964 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743835 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 03:17:57.743964 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.743958 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bj64q\"" Jul 24 03:17:57.744043 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.744021 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 03:17:57.744109 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.744093 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.746041 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.746023 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.747717 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.747702 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.748249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.748226 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 03:17:57.748598 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.748583 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 03:17:57.748771 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.748754 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:57.748856 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.748834 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:17:57.748942 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.748930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 03:17:57.749007 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.748951 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jb982\"" Jul 24 03:17:57.749055 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.748952 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r9zrw\"" Jul 24 03:17:57.749639 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.749614 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:17:57.749790 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.749771 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 03:17:57.749865 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.749791 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 03:17:57.749984 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.749791 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 03:17:57.750397 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.750382 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.750513 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.750499 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 03:17:57.750565 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.750515 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 03:17:57.752921 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.751203 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zsk7h\"" Jul 24 03:17:57.752921 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.751269 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 03:17:57.752921 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.752488 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4pz46\"" Jul 24 03:17:57.752921 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.752883 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 03:17:57.753481 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.753468 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 03:17:57.766441 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.766421 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-46s7c" Jul 24 03:17:57.772712 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.772658 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 03:12:56 +0000 UTC" deadline="2028-01-18 14:24:31.360662738 +0000 UTC" Jul 24 03:17:57.772712 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.772710 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13043h6m33.587955662s" Jul 24 03:17:57.775716 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.775697 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-46s7c" Jul 24 03:17:57.835258 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.835236 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 03:17:57.839894 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.839874 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-kubernetes\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.840030 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.839900 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysctl-d\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.840030 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.839918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-systemd-units\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840030 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.839933 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03da7670-36bd-46c8-b003-fa436f6f41ff-iptables-alerter-script\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.840030 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.839952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-cni-multus\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840030 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c39e2500-86ee-456c-b8da-02c397d1e265-multus-daemon-config\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840042 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840059 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7631783f-0019-4817-9181-c0409dfe6ab7-ovn-node-metrics-cert\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ljqf\" (UniqueName: \"kubernetes.io/projected/2d202ea7-a61f-4339-817b-2c19f914f343-kube-api-access-5ljqf\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.840211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fn4q\" (UniqueName: \"kubernetes.io/projected/434d1dd7-7bea-4781-b385-eeed01587e4a-kube-api-access-4fn4q\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:57.840211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-system-cni-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-os-release\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840173 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c0d2909-d462-42a6-b748-4bfa4d3016b3-agent-certs\") pod \"konnectivity-agent-k2bwb\" (UID: \"3c0d2909-d462-42a6-b748-4bfa4d3016b3\") " pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:17:57.840211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840203 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-sys-fs\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840226 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-netns\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840245 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-ovnkube-script-lib\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-dbus\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7rlx\" (UniqueName: \"kubernetes.io/projected/03da7670-36bd-46c8-b003-fa436f6f41ff-kube-api-access-r7rlx\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysconfig\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-device-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-etc-selinux\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-k8s-cni-cncf-io\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-conf-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840474 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/035aef4d-c1ba-4acf-abe0-00149bc69aaa-hosts-file\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-tuned\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840495 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d443d11-15fc-42e4-9492-2fd15d91f1f3-tmp\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-socket-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-log-socket\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-cni-bin\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-ovnkube-config\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-env-overrides\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840706 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcncc\" (UniqueName: \"kubernetes.io/projected/7631783f-0019-4817-9181-c0409dfe6ab7-kube-api-access-hcncc\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d202ea7-a61f-4339-817b-2c19f914f343-host\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840782 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-os-release\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840796 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-socket-dir-parent\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysctl-conf\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-systemd\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-kubelet\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.840947 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7mfr\" (UniqueName: \"kubernetes.io/projected/035aef4d-c1ba-4acf-abe0-00149bc69aaa-kube-api-access-c7mfr\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840915 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c0d2909-d462-42a6-b748-4bfa4d3016b3-konnectivity-ca\") pod \"konnectivity-agent-k2bwb\" (UID: \"3c0d2909-d462-42a6-b748-4bfa4d3016b3\") " pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840939 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.840977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/035aef4d-c1ba-4acf-abe0-00149bc69aaa-tmp-dir\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-run\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-var-lib-kubelet\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-kubelet\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841102 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dwgq\" (UniqueName: \"kubernetes.io/projected/75e78afb-c175-4ace-aea2-8d4982eebb02-kube-api-access-2dwgq\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-cnibin\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-run-netns\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841176 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-ovn\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841197 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-node-log\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d202ea7-a61f-4339-817b-2c19f914f343-serviceca\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841264 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-system-cni-dir\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.841669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-sys\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841338 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-slash\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-etc-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-cnibin\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841432 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-systemd\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841497 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c0d2909-d462-42a6-b748-4bfa4d3016b3-konnectivity-ca\") pod \"konnectivity-agent-k2bwb\" (UID: \"3c0d2909-d462-42a6-b748-4bfa4d3016b3\") " pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841676 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-kubelet-config\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841698 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch8zx\" (UniqueName: \"kubernetes.io/projected/80fba38e-bd9b-4743-9a32-14fd65113fbe-kube-api-access-ch8zx\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-cni-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841757 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-multus-certs\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-etc-kubernetes\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-modprobe-d\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.842220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841818 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-registration-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c39e2500-86ee-456c-b8da-02c397d1e265-cni-binary-copy\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841870 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-lib-modules\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-host\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-var-lib-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-cni-netd\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.841979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzzzn\" (UniqueName: \"kubernetes.io/projected/c39e2500-86ee-456c-b8da-02c397d1e265-kube-api-access-zzzzn\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.842003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvdb\" (UniqueName: \"kubernetes.io/projected/0d443d11-15fc-42e4-9492-2fd15d91f1f3-kube-api-access-jfvdb\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.842038 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03da7670-36bd-46c8-b003-fa436f6f41ff-host-slash\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.842062 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.842085 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.842124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-cni-bin\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.842830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.842150 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-hostroot\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.843918 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.843880 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c0d2909-d462-42a6-b748-4bfa4d3016b3-agent-certs\") pod \"konnectivity-agent-k2bwb\" (UID: \"3c0d2909-d462-42a6-b748-4bfa4d3016b3\") " pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:17:57.943050 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943018 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-sys-fs\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.943050 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-netns\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943067 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-ovnkube-script-lib\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-dbus\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7rlx\" (UniqueName: \"kubernetes.io/projected/03da7670-36bd-46c8-b003-fa436f6f41ff-kube-api-access-r7rlx\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943128 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysconfig\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943129 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-sys-fs\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-device-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943199 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-device-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943203 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysconfig\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943210 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-etc-selinux\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943261 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-k8s-cni-cncf-io\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943297 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-dbus\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943130 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-netns\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.943322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943305 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-conf-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943338 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-conf-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943339 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-k8s-cni-cncf-io\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943305 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-etc-selinux\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/035aef4d-c1ba-4acf-abe0-00149bc69aaa-hosts-file\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-tuned\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d443d11-15fc-42e4-9492-2fd15d91f1f3-tmp\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-socket-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943446 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/035aef4d-c1ba-4acf-abe0-00149bc69aaa-hosts-file\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-log-socket\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943485 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-cni-bin\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943507 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-ovnkube-config\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943530 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-env-overrides\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943539 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-log-socket\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943547 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-socket-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943550 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-cni-bin\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcncc\" (UniqueName: \"kubernetes.io/projected/7631783f-0019-4817-9181-c0409dfe6ab7-kube-api-access-hcncc\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d202ea7-a61f-4339-817b-2c19f914f343-host\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.943914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943670 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-os-release\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-socket-dir-parent\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943710 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysctl-conf\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-systemd\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-kubelet\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943796 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7mfr\" (UniqueName: \"kubernetes.io/projected/035aef4d-c1ba-4acf-abe0-00149bc69aaa-kube-api-access-c7mfr\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943822 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943833 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-os-release\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943848 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-ovnkube-script-lib\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/035aef4d-c1ba-4acf-abe0-00149bc69aaa-tmp-dir\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943880 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d202ea7-a61f-4339-817b-2c19f914f343-host\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943914 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-env-overrides\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-kubelet\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.943961 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.943937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-run\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-var-lib-kubelet\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.944937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-kubelet\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944038 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7631783f-0019-4817-9181-c0409dfe6ab7-ovnkube-config\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dwgq\" (UniqueName: \"kubernetes.io/projected/75e78afb-c175-4ace-aea2-8d4982eebb02-kube-api-access-2dwgq\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944057 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysctl-conf\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944089 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-cnibin\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944093 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-var-lib-kubelet\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-run-netns\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944114 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-socket-dir-parent\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944139 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-systemd\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944152 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/035aef4d-c1ba-4acf-abe0-00149bc69aaa-tmp-dir\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944179 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-run\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944187 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-kubelet\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944157 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-run-netns\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944224 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-cnibin\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.944235 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret podName:22cf01fa-32a1-49b0-9722-d3fbd4fcb738 nodeName:}" failed. No retries permitted until 2026-07-24 03:17:58.444213204 +0000 UTC m=+2.018863113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret") pod "global-pull-secret-syncer-b25hj" (UID: "22cf01fa-32a1-49b0-9722-d3fbd4fcb738") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944255 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-ovn\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944267 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.945805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-node-log\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944339 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-node-log\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d202ea7-a61f-4339-817b-2c19f914f343-serviceca\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944378 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-run-ovn-kubernetes\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944385 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-system-cni-dir\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944425 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-ovn\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-system-cni-dir\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-sys\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944502 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-slash\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-etc-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944561 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-sys\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944564 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944599 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-slash\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-cnibin\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944630 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944633 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/80fba38e-bd9b-4743-9a32-14fd65113fbe-cnibin\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.946603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-systemd\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944669 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-etc-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944680 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-kubelet-config\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch8zx\" (UniqueName: \"kubernetes.io/projected/80fba38e-bd9b-4743-9a32-14fd65113fbe-kube-api-access-ch8zx\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-cni-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.944787 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944793 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d202ea7-a61f-4339-817b-2c19f914f343-serviceca\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944807 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-multus-certs\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.944843 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs podName:434d1dd7-7bea-4781-b385-eeed01587e4a nodeName:}" failed. No retries permitted until 2026-07-24 03:17:58.444827299 +0000 UTC m=+2.019477223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs") pod "network-metrics-daemon-qtwg5" (UID: "434d1dd7-7bea-4781-b385-eeed01587e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944858 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-run-multus-certs\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944850 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944894 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-etc-kubernetes\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944949 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944961 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-multus-cni-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-etc-kubernetes\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.947204 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.944997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-modprobe-d\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945014 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-systemd\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945022 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-registration-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945048 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c39e2500-86ee-456c-b8da-02c397d1e265-cni-binary-copy\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-lib-modules\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945089 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-modprobe-d\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-host\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945131 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-kubelet-config\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-var-lib-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-cni-netd\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945169 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-var-lib-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzzzn\" (UniqueName: \"kubernetes.io/projected/c39e2500-86ee-456c-b8da-02c397d1e265-kube-api-access-zzzzn\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945232 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-host-cni-netd\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-host\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945303 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvdb\" (UniqueName: \"kubernetes.io/projected/0d443d11-15fc-42e4-9492-2fd15d91f1f3-kube-api-access-jfvdb\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945367 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-registration-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.947912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03da7670-36bd-46c8-b003-fa436f6f41ff-host-slash\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945419 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03da7670-36bd-46c8-b003-fa436f6f41ff-host-slash\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945467 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-lib-modules\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-cni-bin\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-hostroot\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945535 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75e78afb-c175-4ace-aea2-8d4982eebb02-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945578 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-hostroot\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945607 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-kubernetes\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysctl-d\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-systemd-units\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945700 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c39e2500-86ee-456c-b8da-02c397d1e265-cni-binary-copy\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03da7670-36bd-46c8-b003-fa436f6f41ff-iptables-alerter-script\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945748 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-cni-bin\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945769 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-kubernetes\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945814 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-cni-multus\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945841 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c39e2500-86ee-456c-b8da-02c397d1e265-multus-daemon-config\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.948501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945844 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-host-var-lib-cni-multus\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945877 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-systemd-units\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945888 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/80fba38e-bd9b-4743-9a32-14fd65113fbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945958 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7631783f-0019-4817-9181-c0409dfe6ab7-run-openvswitch\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.945997 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-sysctl-d\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7631783f-0019-4817-9181-c0409dfe6ab7-ovn-node-metrics-cert\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljqf\" (UniqueName: \"kubernetes.io/projected/2d202ea7-a61f-4339-817b-2c19f914f343-kube-api-access-5ljqf\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946246 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fn4q\" (UniqueName: \"kubernetes.io/projected/434d1dd7-7bea-4781-b385-eeed01587e4a-kube-api-access-4fn4q\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-system-cni-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-os-release\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946422 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-os-release\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946427 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0d443d11-15fc-42e4-9492-2fd15d91f1f3-etc-tuned\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946459 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c39e2500-86ee-456c-b8da-02c397d1e265-system-cni-dir\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946458 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c39e2500-86ee-456c-b8da-02c397d1e265-multus-daemon-config\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946470 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03da7670-36bd-46c8-b003-fa436f6f41ff-iptables-alerter-script\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.946837 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d443d11-15fc-42e4-9492-2fd15d91f1f3-tmp\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.949098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.948535 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7631783f-0019-4817-9181-c0409dfe6ab7-ovn-node-metrics-cert\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.952674 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.952646 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7rlx\" (UniqueName: \"kubernetes.io/projected/03da7670-36bd-46c8-b003-fa436f6f41ff-kube-api-access-r7rlx\") pod \"iptables-alerter-x5xms\" (UID: \"03da7670-36bd-46c8-b003-fa436f6f41ff\") " pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:57.953052 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.952975 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7mfr\" (UniqueName: \"kubernetes.io/projected/035aef4d-c1ba-4acf-abe0-00149bc69aaa-kube-api-access-c7mfr\") pod \"node-resolver-l8k4p\" (UID: \"035aef4d-c1ba-4acf-abe0-00149bc69aaa\") " pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:57.955850 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.955825 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:17:57.955997 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.955856 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:17:57.955997 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.955871 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qzgtg for pod openshift-network-diagnostics/network-check-target-ktlcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:17:57.955997 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:57.955932 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg podName:58390921-c114-4dd6-a334-c3ecadf82534 nodeName:}" failed. No retries permitted until 2026-07-24 03:17:58.455915425 +0000 UTC m=+2.030565351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qzgtg" (UniqueName: "kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg") pod "network-check-target-ktlcb" (UID: "58390921-c114-4dd6-a334-c3ecadf82534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:17:57.957605 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.957582 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzzzn\" (UniqueName: \"kubernetes.io/projected/c39e2500-86ee-456c-b8da-02c397d1e265-kube-api-access-zzzzn\") pod \"multus-qx54p\" (UID: \"c39e2500-86ee-456c-b8da-02c397d1e265\") " pod="openshift-multus/multus-qx54p" Jul 24 03:17:57.958064 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.958045 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvdb\" (UniqueName: \"kubernetes.io/projected/0d443d11-15fc-42e4-9492-2fd15d91f1f3-kube-api-access-jfvdb\") pod \"tuned-vqnlh\" (UID: \"0d443d11-15fc-42e4-9492-2fd15d91f1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:57.958691 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.958668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch8zx\" (UniqueName: \"kubernetes.io/projected/80fba38e-bd9b-4743-9a32-14fd65113fbe-kube-api-access-ch8zx\") pod \"multus-additional-cni-plugins-xx9vb\" (UID: \"80fba38e-bd9b-4743-9a32-14fd65113fbe\") " pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:57.958939 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.958711 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcncc\" (UniqueName: \"kubernetes.io/projected/7631783f-0019-4817-9181-c0409dfe6ab7-kube-api-access-hcncc\") pod \"ovnkube-node-2bqmc\" (UID: \"7631783f-0019-4817-9181-c0409dfe6ab7\") " pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:57.959008 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.958977 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dwgq\" (UniqueName: \"kubernetes.io/projected/75e78afb-c175-4ace-aea2-8d4982eebb02-kube-api-access-2dwgq\") pod \"aws-ebs-csi-driver-node-vjlwg\" (UID: \"75e78afb-c175-4ace-aea2-8d4982eebb02\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:57.959200 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.959182 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fn4q\" (UniqueName: \"kubernetes.io/projected/434d1dd7-7bea-4781-b385-eeed01587e4a-kube-api-access-4fn4q\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:57.960429 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.960412 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ljqf\" (UniqueName: \"kubernetes.io/projected/2d202ea7-a61f-4339-817b-2c19f914f343-kube-api-access-5ljqf\") pod \"node-ca-2gfsv\" (UID: \"2d202ea7-a61f-4339-817b-2c19f914f343\") " pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:57.962900 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:57.962872 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf159a86c6b4d5f653e8cf75ff9bcb623.slice/crio-93cf359fb13ed320dd4b8818a312c9293650019d2f89cf74e0c42524d2ac0fad WatchSource:0}: Error finding container 93cf359fb13ed320dd4b8818a312c9293650019d2f89cf74e0c42524d2ac0fad: Status 404 returned error can't find the container with id 93cf359fb13ed320dd4b8818a312c9293650019d2f89cf74e0c42524d2ac0fad Jul 24 03:17:57.963117 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:57.963091 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c01ed83c1ca76d7a45565c7e1bd3b3.slice/crio-2f7955bf2b59e336fe8ffbef7b37a75922ee51de38d77113b6c72e503332a33c WatchSource:0}: Error finding container 2f7955bf2b59e336fe8ffbef7b37a75922ee51de38d77113b6c72e503332a33c: Status 404 returned error can't find the container with id 2f7955bf2b59e336fe8ffbef7b37a75922ee51de38d77113b6c72e503332a33c Jul 24 03:17:57.966634 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:57.966618 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 03:17:58.066113 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.066033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:17:58.075481 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.075455 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0d2909_d462_42a6_b748_4bfa4d3016b3.slice/crio-42653c690ed7092793ff19fd0794e1217b5f1cc39b308cab20cc653ab7407692 WatchSource:0}: Error finding container 42653c690ed7092793ff19fd0794e1217b5f1cc39b308cab20cc653ab7407692: Status 404 returned error can't find the container with id 42653c690ed7092793ff19fd0794e1217b5f1cc39b308cab20cc653ab7407692 Jul 24 03:17:58.091182 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.091158 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" Jul 24 03:17:58.098603 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.098571 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d443d11_15fc_42e4_9492_2fd15d91f1f3.slice/crio-b7c5b83fa81d7003b4cc73f36e30e3d2cdb09356a5ca7caf7d1381e091584382 WatchSource:0}: Error finding container b7c5b83fa81d7003b4cc73f36e30e3d2cdb09356a5ca7caf7d1381e091584382: Status 404 returned error can't find the container with id b7c5b83fa81d7003b4cc73f36e30e3d2cdb09356a5ca7caf7d1381e091584382 Jul 24 03:17:58.118922 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.118899 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:17:58.127335 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.127313 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7631783f_0019_4817_9181_c0409dfe6ab7.slice/crio-cb12157b93c5a159aac99f391b78e21cd994c0b880db9af3a00fcd4ad8d72b91 WatchSource:0}: Error finding container cb12157b93c5a159aac99f391b78e21cd994c0b880db9af3a00fcd4ad8d72b91: Status 404 returned error can't find the container with id cb12157b93c5a159aac99f391b78e21cd994c0b880db9af3a00fcd4ad8d72b91 Jul 24 03:17:58.132378 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.132361 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" Jul 24 03:17:58.139903 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.139883 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e78afb_c175_4ace_aea2_8d4982eebb02.slice/crio-85a4e85c0eabfda5942fadc6296c02151d2f03248ed2c374581ecb4681e7ea9b WatchSource:0}: Error finding container 85a4e85c0eabfda5942fadc6296c02151d2f03248ed2c374581ecb4681e7ea9b: Status 404 returned error can't find the container with id 85a4e85c0eabfda5942fadc6296c02151d2f03248ed2c374581ecb4681e7ea9b Jul 24 03:17:58.152780 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.152761 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2gfsv" Jul 24 03:17:58.160069 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.160047 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d202ea7_a61f_4339_817b_2c19f914f343.slice/crio-e75c290abd5db413b21210b94b1afbfe8328b1b5b0652b324249707c5fe2509a WatchSource:0}: Error finding container e75c290abd5db413b21210b94b1afbfe8328b1b5b0652b324249707c5fe2509a: Status 404 returned error can't find the container with id e75c290abd5db413b21210b94b1afbfe8328b1b5b0652b324249707c5fe2509a Jul 24 03:17:58.172774 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.172751 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5xms" Jul 24 03:17:58.178720 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.178699 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qx54p" Jul 24 03:17:58.179684 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.179659 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03da7670_36bd_46c8_b003_fa436f6f41ff.slice/crio-c0d5b50cee738cf682e348ce0d552beb330f79bd2be10dce2ccb12b514578c7b WatchSource:0}: Error finding container c0d5b50cee738cf682e348ce0d552beb330f79bd2be10dce2ccb12b514578c7b: Status 404 returned error can't find the container with id c0d5b50cee738cf682e348ce0d552beb330f79bd2be10dce2ccb12b514578c7b Jul 24 03:17:58.185757 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.185738 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39e2500_86ee_456c_b8da_02c397d1e265.slice/crio-b5a9f2e5dc3dd8d0d951aeadc856b1aa74d557daef0189d10b10e60780cafb0e WatchSource:0}: Error finding container b5a9f2e5dc3dd8d0d951aeadc856b1aa74d557daef0189d10b10e60780cafb0e: Status 404 returned error can't find the container with id b5a9f2e5dc3dd8d0d951aeadc856b1aa74d557daef0189d10b10e60780cafb0e Jul 24 03:17:58.195011 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.194994 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" Jul 24 03:17:58.200271 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.200255 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l8k4p" Jul 24 03:17:58.202632 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.202614 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80fba38e_bd9b_4743_9a32_14fd65113fbe.slice/crio-bd7792dd833a55b8a143beb3f175811868a677660ded451245656eafafc11c3c WatchSource:0}: Error finding container bd7792dd833a55b8a143beb3f175811868a677660ded451245656eafafc11c3c: Status 404 returned error can't find the container with id bd7792dd833a55b8a143beb3f175811868a677660ded451245656eafafc11c3c Jul 24 03:17:58.208220 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:17:58.208199 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035aef4d_c1ba_4acf_abe0_00149bc69aaa.slice/crio-f82e4b131e075f29f3e74f94a06edada50a7b8ee7ebe1068af678c5474ebb8ca WatchSource:0}: Error finding container f82e4b131e075f29f3e74f94a06edada50a7b8ee7ebe1068af678c5474ebb8ca: Status 404 returned error can't find the container with id f82e4b131e075f29f3e74f94a06edada50a7b8ee7ebe1068af678c5474ebb8ca Jul 24 03:17:58.243629 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.243604 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:17:58.450571 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.450487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:58.450760 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.450617 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:58.450760 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:58.450631 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:17:58.450760 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:58.450705 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret podName:22cf01fa-32a1-49b0-9722-d3fbd4fcb738 nodeName:}" failed. No retries permitted until 2026-07-24 03:17:59.450684862 +0000 UTC m=+3.025334776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret") pod "global-pull-secret-syncer-b25hj" (UID: "22cf01fa-32a1-49b0-9722-d3fbd4fcb738") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:17:58.450760 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:58.450768 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:17:58.451003 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:58.450836 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs podName:434d1dd7-7bea-4781-b385-eeed01587e4a nodeName:}" failed. No retries permitted until 2026-07-24 03:17:59.450816614 +0000 UTC m=+3.025466541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs") pod "network-metrics-daemon-qtwg5" (UID: "434d1dd7-7bea-4781-b385-eeed01587e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:17:58.551607 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.551081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:17:58.551607 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:58.551202 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:17:58.551607 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:58.551216 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:17:58.551607 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:58.551224 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qzgtg for pod openshift-network-diagnostics/network-check-target-ktlcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:17:58.551607 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:58.551300 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg podName:58390921-c114-4dd6-a334-c3ecadf82534 nodeName:}" failed. No retries permitted until 2026-07-24 03:17:59.551265614 +0000 UTC m=+3.125915525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzgtg" (UniqueName: "kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg") pod "network-check-target-ktlcb" (UID: "58390921-c114-4dd6-a334-c3ecadf82534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:17:58.657584 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.657360 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:17:58.777920 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.777862 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:12:57 +0000 UTC" deadline="2028-04-23 10:06:58.696113024 +0000 UTC" Jul 24 03:17:58.777920 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.777918 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15342h48m59.918199165s" Jul 24 03:17:58.916601 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.916513 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8k4p" event={"ID":"035aef4d-c1ba-4acf-abe0-00149bc69aaa","Type":"ContainerStarted","Data":"f82e4b131e075f29f3e74f94a06edada50a7b8ee7ebe1068af678c5474ebb8ca"} Jul 24 03:17:58.922617 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.922589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerStarted","Data":"bd7792dd833a55b8a143beb3f175811868a677660ded451245656eafafc11c3c"} Jul 24 03:17:58.938517 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.938484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qx54p" event={"ID":"c39e2500-86ee-456c-b8da-02c397d1e265","Type":"ContainerStarted","Data":"b5a9f2e5dc3dd8d0d951aeadc856b1aa74d557daef0189d10b10e60780cafb0e"} Jul 24 03:17:58.946796 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.946767 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" event={"ID":"75e78afb-c175-4ace-aea2-8d4982eebb02","Type":"ContainerStarted","Data":"85a4e85c0eabfda5942fadc6296c02151d2f03248ed2c374581ecb4681e7ea9b"} Jul 24 03:17:58.953115 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.953085 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"cb12157b93c5a159aac99f391b78e21cd994c0b880db9af3a00fcd4ad8d72b91"} Jul 24 03:17:58.961250 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.961221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" event={"ID":"0d443d11-15fc-42e4-9492-2fd15d91f1f3","Type":"ContainerStarted","Data":"b7c5b83fa81d7003b4cc73f36e30e3d2cdb09356a5ca7caf7d1381e091584382"} Jul 24 03:17:58.964982 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.964957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2bwb" event={"ID":"3c0d2909-d462-42a6-b748-4bfa4d3016b3","Type":"ContainerStarted","Data":"42653c690ed7092793ff19fd0794e1217b5f1cc39b308cab20cc653ab7407692"} Jul 24 03:17:58.978124 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.978094 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5xms" event={"ID":"03da7670-36bd-46c8-b003-fa436f6f41ff","Type":"ContainerStarted","Data":"c0d5b50cee738cf682e348ce0d552beb330f79bd2be10dce2ccb12b514578c7b"} Jul 24 03:17:58.998525 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:58.998426 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2gfsv" event={"ID":"2d202ea7-a61f-4339-817b-2c19f914f343","Type":"ContainerStarted","Data":"e75c290abd5db413b21210b94b1afbfe8328b1b5b0652b324249707c5fe2509a"} Jul 24 03:17:59.012352 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.012074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" event={"ID":"f159a86c6b4d5f653e8cf75ff9bcb623","Type":"ContainerStarted","Data":"93cf359fb13ed320dd4b8818a312c9293650019d2f89cf74e0c42524d2ac0fad"} Jul 24 03:17:59.030926 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.030857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" event={"ID":"07c01ed83c1ca76d7a45565c7e1bd3b3","Type":"ContainerStarted","Data":"2f7955bf2b59e336fe8ffbef7b37a75922ee51de38d77113b6c72e503332a33c"} Jul 24 03:17:59.459792 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.458934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:59.459792 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.459000 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:59.459792 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.459143 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:17:59.459792 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.459205 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs podName:434d1dd7-7bea-4781-b385-eeed01587e4a nodeName:}" failed. No retries permitted until 2026-07-24 03:18:01.459186746 +0000 UTC m=+5.033836658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs") pod "network-metrics-daemon-qtwg5" (UID: "434d1dd7-7bea-4781-b385-eeed01587e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:17:59.459792 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.459292 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:17:59.459792 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.459324 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret podName:22cf01fa-32a1-49b0-9722-d3fbd4fcb738 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:01.459314088 +0000 UTC m=+5.033963999 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret") pod "global-pull-secret-syncer-b25hj" (UID: "22cf01fa-32a1-49b0-9722-d3fbd4fcb738") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:17:59.560505 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.559782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:17:59.560505 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.559951 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:17:59.560505 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.560020 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:17:59.560505 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.560035 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qzgtg for pod openshift-network-diagnostics/network-check-target-ktlcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:17:59.560505 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.560091 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg podName:58390921-c114-4dd6-a334-c3ecadf82534 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:01.56007279 +0000 UTC m=+5.134722710 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzgtg" (UniqueName: "kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg") pod "network-check-target-ktlcb" (UID: "58390921-c114-4dd6-a334-c3ecadf82534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:17:59.778221 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.778158 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:12:57 +0000 UTC" deadline="2027-12-30 11:18:59.238617952 +0000 UTC" Jul 24 03:17:59.778221 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.778196 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12584h0m59.460426335s" Jul 24 03:17:59.899438 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.899403 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:17:59.899601 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.899537 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:17:59.899916 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.899899 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:17:59.900010 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.899987 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:17:59.900069 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:17:59.900048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:17:59.900157 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:17:59.900116 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:00.692157 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:00.692066 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:18:00.876297 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:00.876252 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 03:18:01.478485 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:01.478457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:01.478670 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:01.478514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:01.478670 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.478644 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:01.478779 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.478704 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs podName:434d1dd7-7bea-4781-b385-eeed01587e4a nodeName:}" failed. No retries permitted until 2026-07-24 03:18:05.478685928 +0000 UTC m=+9.053335855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs") pod "network-metrics-daemon-qtwg5" (UID: "434d1dd7-7bea-4781-b385-eeed01587e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:01.479131 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.479099 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:01.479242 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.479175 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret podName:22cf01fa-32a1-49b0-9722-d3fbd4fcb738 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:05.479158433 +0000 UTC m=+9.053808343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret") pod "global-pull-secret-syncer-b25hj" (UID: "22cf01fa-32a1-49b0-9722-d3fbd4fcb738") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:01.579563 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:01.579505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:01.579812 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.579764 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:01.579877 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.579824 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:01.579877 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.579838 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qzgtg for pod openshift-network-diagnostics/network-check-target-ktlcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:01.579984 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.579891 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg podName:58390921-c114-4dd6-a334-c3ecadf82534 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:05.579878538 +0000 UTC m=+9.154528448 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzgtg" (UniqueName: "kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg") pod "network-check-target-ktlcb" (UID: "58390921-c114-4dd6-a334-c3ecadf82534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:01.900030 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:01.899954 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:01.900435 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:01.899954 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:01.900435 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.900152 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:01.900435 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.900236 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:01.900435 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:01.899967 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:01.900435 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:01.900340 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:03.899415 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:03.899368 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:03.899822 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:03.899491 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:03.899822 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:03.899521 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:03.899822 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:03.899623 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:03.899822 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:03.899667 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:03.899822 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:03.899714 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:05.513292 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:05.513248 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:05.513765 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:05.513377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:05.513765 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.513405 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:05.513765 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.513485 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs podName:434d1dd7-7bea-4781-b385-eeed01587e4a nodeName:}" failed. No retries permitted until 2026-07-24 03:18:13.513462457 +0000 UTC m=+17.088112370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs") pod "network-metrics-daemon-qtwg5" (UID: "434d1dd7-7bea-4781-b385-eeed01587e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:05.513765 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.513499 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:05.513765 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.513550 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret podName:22cf01fa-32a1-49b0-9722-d3fbd4fcb738 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:13.513535874 +0000 UTC m=+17.088185799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret") pod "global-pull-secret-syncer-b25hj" (UID: "22cf01fa-32a1-49b0-9722-d3fbd4fcb738") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:05.614750 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:05.614679 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:05.614930 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.614912 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:05.615009 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.614934 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:05.615009 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.614947 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qzgtg for pod openshift-network-diagnostics/network-check-target-ktlcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:05.615009 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.614995 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg podName:58390921-c114-4dd6-a334-c3ecadf82534 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:13.614981324 +0000 UTC m=+17.189631239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzgtg" (UniqueName: "kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg") pod "network-check-target-ktlcb" (UID: "58390921-c114-4dd6-a334-c3ecadf82534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:05.899890 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:05.899083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:05.899890 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.899227 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:05.899890 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:05.899622 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:05.899890 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.899696 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:05.899890 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:05.899741 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:05.899890 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:05.899805 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:07.899482 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:07.899441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:07.899482 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:07.899474 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:07.900006 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:07.899441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:07.900006 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:07.899567 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:07.900006 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:07.899641 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:07.900006 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:07.899709 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:09.899138 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:09.899100 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:09.899667 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:09.899243 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:09.899667 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:09.899660 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:09.899777 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:09.899761 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:09.899830 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:09.899810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:09.899893 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:09.899873 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:11.899315 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:11.899261 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:11.899742 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:11.899267 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:11.899742 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:11.899419 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:11.899742 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:11.899267 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:11.899742 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:11.899503 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:11.899742 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:11.899583 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:13.577209 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:13.577136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:13.577209 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:13.577181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:13.577528 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.577311 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:13.577528 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.577312 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:13.577528 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.577362 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs podName:434d1dd7-7bea-4781-b385-eeed01587e4a nodeName:}" failed. No retries permitted until 2026-07-24 03:18:29.577348457 +0000 UTC m=+33.151998366 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs") pod "network-metrics-daemon-qtwg5" (UID: "434d1dd7-7bea-4781-b385-eeed01587e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:13.577528 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.577375 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret podName:22cf01fa-32a1-49b0-9722-d3fbd4fcb738 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:29.577369243 +0000 UTC m=+33.152019153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret") pod "global-pull-secret-syncer-b25hj" (UID: "22cf01fa-32a1-49b0-9722-d3fbd4fcb738") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:13.678403 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:13.678372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:13.678594 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.678569 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:13.678655 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.678599 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:13.678655 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.678611 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qzgtg for pod openshift-network-diagnostics/network-check-target-ktlcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:13.678747 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.678679 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg podName:58390921-c114-4dd6-a334-c3ecadf82534 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:29.678660291 +0000 UTC m=+33.253310215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzgtg" (UniqueName: "kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg") pod "network-check-target-ktlcb" (UID: "58390921-c114-4dd6-a334-c3ecadf82534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:13.899545 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:13.899466 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:13.899766 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:13.899466 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:13.899766 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.899599 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:13.899766 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:13.899467 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:13.899766 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.899639 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:13.899766 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:13.899681 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:15.899564 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:15.899524 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:15.899999 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:15.899576 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:15.899999 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:15.899662 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:15.899999 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:15.899698 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:15.899999 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:15.899748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:15.899999 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:15.899854 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:17.899848 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:17.899823 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:17.900165 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:17.899860 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:17.900165 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:17.899833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:17.900165 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:17.899925 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:17.900165 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:17.900031 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:17.900165 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:17.900083 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:19.086732 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.086322 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l8k4p" event={"ID":"035aef4d-c1ba-4acf-abe0-00149bc69aaa","Type":"ContainerStarted","Data":"90cb6c1f0ac24f58b030650d3a272d0d1a9eddfed313a4f72aa29b2798550a01"} Jul 24 03:18:19.088120 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.088097 2559 generic.go:356] "Generic (PLEG): container finished" podID="80fba38e-bd9b-4743-9a32-14fd65113fbe" containerID="28771e4ef825872d6de58708038ec34a4a78e9b58fbb858f78657d6a083ecffd" exitCode=0 Jul 24 03:18:19.088207 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.088173 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerDied","Data":"28771e4ef825872d6de58708038ec34a4a78e9b58fbb858f78657d6a083ecffd"} Jul 24 03:18:19.089647 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.089625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qx54p" event={"ID":"c39e2500-86ee-456c-b8da-02c397d1e265","Type":"ContainerStarted","Data":"b625ffa090b42c64f412738b72d73b3c630f58b1271908260816acbb74171d5e"} Jul 24 03:18:19.091420 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.091401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" event={"ID":"75e78afb-c175-4ace-aea2-8d4982eebb02","Type":"ContainerStarted","Data":"34180c662cf9529634ed3f790d2b5e5d03d5afc9db74780e039a00f0bf2b51d8"} Jul 24 03:18:19.095769 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.095751 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:18:19.096065 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.096042 2559 generic.go:356] "Generic (PLEG): container finished" podID="7631783f-0019-4817-9181-c0409dfe6ab7" containerID="b518acba93a758aa254a53b9bcc6f3466cc399907c1480bd075275a2278d01aa" exitCode=1 Jul 24 03:18:19.096117 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.096108 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"784d8cdb1474809f93ad851179e48e4b31725ab205cd1b7e6eef46267e057a8f"} Jul 24 03:18:19.096172 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.096161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"fb01ffc941ed4a1bea9f8f85fd4000524346f9c43336ffd4582b0d634f814606"} Jul 24 03:18:19.096212 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.096194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"55307e4af7733ad7ac8a54f82277da0e23825118751cfb380ed34dd8cf0f7678"} Jul 24 03:18:19.096245 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.096220 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerDied","Data":"b518acba93a758aa254a53b9bcc6f3466cc399907c1480bd075275a2278d01aa"} Jul 24 03:18:19.096314 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.096250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"9c795cd79439df4fa8cb5f91d803fc06355d035a14a5205f2ff13ff7f2a6364b"} Jul 24 03:18:19.097419 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.097400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" event={"ID":"0d443d11-15fc-42e4-9492-2fd15d91f1f3","Type":"ContainerStarted","Data":"bd721ed7d1f6c8248245ad3ea825eb48474b2a27fe8c234a4ca22c1063d5e7b5"} Jul 24 03:18:19.098678 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.098661 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2bwb" event={"ID":"3c0d2909-d462-42a6-b748-4bfa4d3016b3","Type":"ContainerStarted","Data":"73a367e397e03d9e1779112ddc4eadf7744fea13528a0bee9666ff9c64e6a94f"} Jul 24 03:18:19.100045 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.100026 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2gfsv" event={"ID":"2d202ea7-a61f-4339-817b-2c19f914f343","Type":"ContainerStarted","Data":"f9522944032514666ac90de7c23972169d6b77c8657f5ced949d4546d67175f8"} Jul 24 03:18:19.101637 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.101618 2559 generic.go:356] "Generic (PLEG): container finished" podID="f159a86c6b4d5f653e8cf75ff9bcb623" containerID="24f40ce21c0aa857c389266b9b81f4bfa1c2909cb97ff123781ff60d76aa00fa" exitCode=0 Jul 24 03:18:19.101788 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.101678 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" event={"ID":"f159a86c6b4d5f653e8cf75ff9bcb623","Type":"ContainerDied","Data":"24f40ce21c0aa857c389266b9b81f4bfa1c2909cb97ff123781ff60d76aa00fa"} Jul 24 03:18:19.103087 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.103067 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" event={"ID":"07c01ed83c1ca76d7a45565c7e1bd3b3","Type":"ContainerStarted","Data":"e1fe819c9dadde98a1eb77e8158e676ecf557858e3c06d64ce06f6e22626fa52"} Jul 24 03:18:19.103378 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.103341 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l8k4p" podStartSLOduration=2.470027634 podStartE2EDuration="22.103328041s" totalImagesPullingTime="19.633300407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:19.103050097 +0000 UTC m=+22.677700030" watchObservedRunningTime="2026-07-24 03:18:19.103328041 +0000 UTC m=+22.677977972" Jul 24 03:18:19.138749 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.138706 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vqnlh" podStartSLOduration=3.430968178 podStartE2EDuration="23.138696301s" totalImagesPullingTime="19.707728123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:19.138577036 +0000 UTC m=+22.713226967" watchObservedRunningTime="2026-07-24 03:18:19.138696301 +0000 UTC m=+22.713346232" Jul 24 03:18:19.158513 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.158249 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qx54p" podStartSLOduration=2.5081251 podStartE2EDuration="22.158229527s" totalImagesPullingTime="19.650104427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:19.157949135 +0000 UTC m=+22.732599067" watchObservedRunningTime="2026-07-24 03:18:19.158229527 +0000 UTC m=+22.732879439" Jul 24 03:18:19.228975 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.228927 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k2bwb" podStartSLOduration=3.470212525 podStartE2EDuration="23.228912331s" totalImagesPullingTime="19.758699806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:19.228507175 +0000 UTC m=+22.803157125" watchObservedRunningTime="2026-07-24 03:18:19.228912331 +0000 UTC m=+22.803562293" Jul 24 03:18:19.246346 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.246305 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2gfsv" podStartSLOduration=3.600006001 podStartE2EDuration="23.246269234s" totalImagesPullingTime="19.646263233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:19.24615721 +0000 UTC m=+22.820807162" watchObservedRunningTime="2026-07-24 03:18:19.246269234 +0000 UTC m=+22.820919166" Jul 24 03:18:19.267797 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.267752 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-95.ec2.internal" podStartSLOduration=22.267734445 podStartE2EDuration="22.267734445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:19.267346697 +0000 UTC m=+22.841996650" watchObservedRunningTime="2026-07-24 03:18:19.267734445 +0000 UTC m=+22.842384377" Jul 24 03:18:19.723102 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.723068 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:18:19.723627 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.723605 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:18:19.899568 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.899539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:19.899749 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.899539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:19.899749 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:19.899667 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:19.899749 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:19.899728 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:19.899749 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:19.899539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:19.899897 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:19.899792 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:20.026146 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.026115 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 03:18:20.108070 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.108032 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" event={"ID":"75e78afb-c175-4ace-aea2-8d4982eebb02","Type":"ContainerStarted","Data":"7c9006a80dcb9b608e5ba700754120511023ca43406cf97c5d67f62587c84013"} Jul 24 03:18:20.113113 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.113091 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:18:20.113600 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.113574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"e49f0367b3d348e5d29ef323c659493aeb1f5be678d41a96525ae906c1ae3778"} Jul 24 03:18:20.115253 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.115230 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5xms" event={"ID":"03da7670-36bd-46c8-b003-fa436f6f41ff","Type":"ContainerStarted","Data":"3569f054c231fe139c1d8bffdefad0edc06f69fa3ffc94e8f85c22e08efdf942"} Jul 24 03:18:20.117453 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.117402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" event={"ID":"f159a86c6b4d5f653e8cf75ff9bcb623","Type":"ContainerStarted","Data":"e97064446ee71a49a0b920052bdaa6226f2c2bd720e44b2c12eaaca2a2cbe7ec"} Jul 24 03:18:20.131617 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.131557 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x5xms" podStartSLOduration=3.4765812179999998 podStartE2EDuration="23.131536511s" totalImagesPullingTime="19.654955293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:20.13115947 +0000 UTC m=+23.705809404" watchObservedRunningTime="2026-07-24 03:18:20.131536511 +0000 UTC m=+23.706186444" Jul 24 03:18:20.826810 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.826711 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T03:18:20.02614014Z","UUID":"de145052-ed2c-48ab-9f81-8b219cb702a7","Handler":null,"Name":"","Endpoint":""} Jul 24 03:18:20.828391 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.828352 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 03:18:20.828555 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:20.828399 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 03:18:21.119642 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:21.119566 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 24 03:18:21.899682 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:21.899650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:21.899836 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:21.899650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:21.899836 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:21.899760 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:21.899836 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:21.899650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:21.899938 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:21.899833 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:21.899938 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:21.899883 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:22.126032 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:22.126003 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:18:22.126579 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:22.126503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"47f0069cc7feb038959f721d155847f7ff6d07fee311f6d04d68a281649d24da"} Jul 24 03:18:22.128832 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:22.128753 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" event={"ID":"75e78afb-c175-4ace-aea2-8d4982eebb02","Type":"ContainerStarted","Data":"e2d01ffd55d43302f9d936c2fbea9b442f91f957b7b533c25ddcea611d02aa35"} Jul 24 03:18:22.152048 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:22.151958 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vjlwg" podStartSLOduration=4.050554286 podStartE2EDuration="26.151937608s" totalImagesPullingTime="22.101383322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:22.151541714 +0000 UTC m=+25.726191673" watchObservedRunningTime="2026-07-24 03:18:22.151937608 +0000 UTC m=+25.726587542" Jul 24 03:18:22.152196 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:22.152160 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-95.ec2.internal" podStartSLOduration=25.1521518 podStartE2EDuration="25.1521518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:20.162496244 +0000 UTC m=+23.737146197" watchObservedRunningTime="2026-07-24 03:18:22.1521518 +0000 UTC m=+25.726801733" Jul 24 03:18:22.422381 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:22.422289 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:18:22.422558 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:22.422443 2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 24 03:18:22.422942 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:22.422918 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k2bwb" Jul 24 03:18:23.899446 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:23.899296 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:23.899785 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:23.899335 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:23.899785 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:23.899532 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:23.899785 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:23.899358 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:23.899785 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:23.899642 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:23.899785 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:23.899725 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:24.136941 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:24.136917 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:18:24.137323 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:24.137296 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"fdf384136214535da76a9412fc4251c481fec0a0092f159ce8a7bc29db588add"} Jul 24 03:18:24.137532 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:24.137509 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:18:24.137652 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:24.137587 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:18:24.137740 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:24.137727 2559 scope.go:117] "RemoveContainer" containerID="b518acba93a758aa254a53b9bcc6f3466cc399907c1480bd075275a2278d01aa" Jul 24 03:18:24.139521 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:24.139450 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerStarted","Data":"5d4bd57177ee68217e608e7cceb324446350c712d7ca54e3d656b8d085f8410d"} Jul 24 03:18:24.154912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:24.154870 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:18:25.143662 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.143630 2559 generic.go:356] "Generic (PLEG): container finished" podID="80fba38e-bd9b-4743-9a32-14fd65113fbe" containerID="5d4bd57177ee68217e608e7cceb324446350c712d7ca54e3d656b8d085f8410d" exitCode=0 Jul 24 03:18:25.144504 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.143706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerDied","Data":"5d4bd57177ee68217e608e7cceb324446350c712d7ca54e3d656b8d085f8410d"} Jul 24 03:18:25.147941 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.147924 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:18:25.148264 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.148243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" event={"ID":"7631783f-0019-4817-9181-c0409dfe6ab7","Type":"ContainerStarted","Data":"85fa9cdd027317f2eaa3bbeb5f8274cb8067330f237e30d7b8a237f6d823b127"} Jul 24 03:18:25.148496 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.148481 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:18:25.163819 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.163798 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:18:25.199337 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.199239 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" podStartSLOduration=8.930419958 podStartE2EDuration="29.199218289s" totalImagesPullingTime="20.268798331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:25.197566703 +0000 UTC m=+28.772216664" watchObservedRunningTime="2026-07-24 03:18:25.199218289 +0000 UTC m=+28.773868222" Jul 24 03:18:25.900053 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.899968 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:25.900053 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.900033 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:25.900266 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:25.900062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:25.900266 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:25.900172 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:25.900266 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:25.900214 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:25.900266 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:25.900265 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:26.208897 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:26.208663 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qtwg5"] Jul 24 03:18:26.209362 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:26.208914 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:26.209362 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:26.209011 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:26.210683 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:26.210661 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ktlcb"] Jul 24 03:18:26.210838 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:26.210829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:26.210937 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:26.210918 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:26.211412 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:26.211375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b25hj"] Jul 24 03:18:26.211522 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:26.211455 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:26.211584 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:26.211540 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:27.155069 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:27.155041 2559 generic.go:356] "Generic (PLEG): container finished" podID="80fba38e-bd9b-4743-9a32-14fd65113fbe" containerID="fa7d7eade4ce7606baf61179136e8fd663d1adb1c3742b04c3a94227b9a49d72" exitCode=0 Jul 24 03:18:27.155239 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:27.155119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerDied","Data":"fa7d7eade4ce7606baf61179136e8fd663d1adb1c3742b04c3a94227b9a49d72"} Jul 24 03:18:27.899484 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:27.899405 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:27.899895 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:27.899405 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:27.899895 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:27.899528 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:27.899895 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:27.899546 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:27.899895 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:27.899664 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:27.899895 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:27.899741 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:29.161086 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:29.161055 2559 generic.go:356] "Generic (PLEG): container finished" podID="80fba38e-bd9b-4743-9a32-14fd65113fbe" containerID="014ae53ec53362109bbaa237e2f1353784fc9381e35be932efedecd5a060b880" exitCode=0 Jul 24 03:18:29.161474 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:29.161118 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerDied","Data":"014ae53ec53362109bbaa237e2f1353784fc9381e35be932efedecd5a060b880"} Jul 24 03:18:29.599371 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:29.599333 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:29.599561 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:29.599389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:29.599561 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.599482 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:29.599561 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.599551 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs podName:434d1dd7-7bea-4781-b385-eeed01587e4a nodeName:}" failed. No retries permitted until 2026-07-24 03:19:01.599536232 +0000 UTC m=+65.174186158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs") pod "network-metrics-daemon-qtwg5" (UID: "434d1dd7-7bea-4781-b385-eeed01587e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 03:18:29.599740 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.599482 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:29.599740 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.599624 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret podName:22cf01fa-32a1-49b0-9722-d3fbd4fcb738 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:01.599609058 +0000 UTC m=+65.174258969 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret") pod "global-pull-secret-syncer-b25hj" (UID: "22cf01fa-32a1-49b0-9722-d3fbd4fcb738") : object "kube-system"/"original-pull-secret" not registered Jul 24 03:18:29.700516 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:29.700479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:29.700671 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.700617 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 03:18:29.700671 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.700633 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 03:18:29.700671 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.700642 2559 projected.go:196] Error preparing data for projected volume kube-api-access-qzgtg for pod openshift-network-diagnostics/network-check-target-ktlcb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:29.700772 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.700696 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg podName:58390921-c114-4dd6-a334-c3ecadf82534 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:01.700680591 +0000 UTC m=+65.275330520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qzgtg" (UniqueName: "kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg") pod "network-check-target-ktlcb" (UID: "58390921-c114-4dd6-a334-c3ecadf82534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 03:18:29.899762 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:29.899684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:29.899762 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:29.899700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:29.899762 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:29.899707 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:29.900067 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.899810 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtwg5" podUID="434d1dd7-7bea-4781-b385-eeed01587e4a" Jul 24 03:18:29.900067 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.899904 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ktlcb" podUID="58390921-c114-4dd6-a334-c3ecadf82534" Jul 24 03:18:29.900067 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:29.900006 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b25hj" podUID="22cf01fa-32a1-49b0-9722-d3fbd4fcb738" Jul 24 03:18:31.283553 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.283519 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-95.ec2.internal" event="NodeReady" Jul 24 03:18:31.283967 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.283692 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 03:18:31.323054 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.323021 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs"] Jul 24 03:18:31.327755 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.327716 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj"] Jul 24 03:18:31.327914 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.327895 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.330321 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.330289 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d7f4d4684-cz5n2"] Jul 24 03:18:31.330460 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.330358 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.330742 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.330718 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jdldz\"" Jul 24 03:18:31.331197 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.331178 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 24 03:18:31.331826 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.331593 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.332033 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.332016 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-5p6ql"] Jul 24 03:18:31.332252 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.332236 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.333131 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.333111 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 24 03:18:31.333296 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.333257 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 24 03:18:31.333406 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.333327 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 24 03:18:31.333406 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.333205 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5sqd4\"" Jul 24 03:18:31.333516 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.333261 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.333516 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.333327 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.333516 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.333161 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.334039 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.334023 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv"] Jul 24 03:18:31.334137 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.334124 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.334659 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.334640 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 03:18:31.334748 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.334714 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 03:18:31.335359 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.335254 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-frvz7\"" Jul 24 03:18:31.335359 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.335257 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 03:18:31.336256 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.336236 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8"] Jul 24 03:18:31.336379 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.336328 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv" Jul 24 03:18:31.337870 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.337850 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67f88b97c-dvxwx"] Jul 24 03:18:31.337975 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.337961 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.339763 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.339748 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb"] Jul 24 03:18:31.339857 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.339845 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.340644 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.340621 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 24 03:18:31.340860 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.340844 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.340860 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.340857 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xz8sq\"" Jul 24 03:18:31.340988 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.340906 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 24 03:18:31.340988 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.340930 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.340988 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.340843 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.341130 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.341000 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.341130 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.341073 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.341130 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.341078 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 24 03:18:31.341974 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.341842 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 24 03:18:31.341974 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.341863 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wqnc9\"" Jul 24 03:18:31.341974 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.341851 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-58xq5\"" Jul 24 03:18:31.341974 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.341927 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.342208 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.342107 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rs8hf"] Jul 24 03:18:31.342208 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.342159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:31.342956 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.342937 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 03:18:31.343772 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.343754 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 24 03:18:31.343850 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.343793 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.344176 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.344155 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vm6xj\"" Jul 24 03:18:31.344260 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.344243 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.344623 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.344429 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 24 03:18:31.344623 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.344444 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 24 03:18:31.344623 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.344459 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 24 03:18:31.344623 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.344431 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.345691 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.345243 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj"] Jul 24 03:18:31.354176 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.354083 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 24 03:18:31.354685 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.354662 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.355545 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.355525 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 24 03:18:31.355657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.355570 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-97jhl\"" Jul 24 03:18:31.359805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.356337 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.359805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.356395 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.359805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.357334 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wb6lh\"" Jul 24 03:18:31.359805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.358011 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 24 03:18:31.359805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.358730 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 24 03:18:31.359805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.358941 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.360168 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.360147 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs"] Jul 24 03:18:31.361641 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.361615 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 24 03:18:31.361861 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.361730 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7f4d4684-cz5n2"] Jul 24 03:18:31.362922 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.362903 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb"] Jul 24 03:18:31.363809 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.363793 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8"] Jul 24 03:18:31.364719 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.364693 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt"] Jul 24 03:18:31.368854 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.368834 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6jj77"] Jul 24 03:18:31.370091 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.370066 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt" Jul 24 03:18:31.371466 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.371446 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67f88b97c-dvxwx"] Jul 24 03:18:31.371605 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.371486 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fn82q"] Jul 24 03:18:31.371803 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.371781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.372736 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.372721 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.373031 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.373017 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.373629 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.373566 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5c5zc"] Jul 24 03:18:31.373629 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.373590 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kngjs\"" Jul 24 03:18:31.373911 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.373889 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gd8s9\"" Jul 24 03:18:31.374129 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.374111 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 03:18:31.374207 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.374154 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 03:18:31.374395 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.374378 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:31.375556 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.375537 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-5p6ql"] Jul 24 03:18:31.375645 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.375579 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv"] Jul 24 03:18:31.375645 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.375599 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt"] Jul 24 03:18:31.375645 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.375616 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6jj77"] Jul 24 03:18:31.375645 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.375639 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5c5zc"] Jul 24 03:18:31.375836 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.375655 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rs8hf"] Jul 24 03:18:31.375836 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.375696 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5c5zc" Jul 24 03:18:31.376425 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.376406 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 24 03:18:31.376640 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.376614 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hbzxx\"" Jul 24 03:18:31.376850 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.376672 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 24 03:18:31.377891 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.377874 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 03:18:31.378324 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.378239 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 03:18:31.378431 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.378354 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 03:18:31.378515 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.378505 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mnmfg\"" Jul 24 03:18:31.383879 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.383861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fn82q"] Jul 24 03:18:31.414913 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.414888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mxtv\" (UniqueName: \"kubernetes.io/projected/cb09d7be-7af6-49c0-bc46-5c27691156ce-kube-api-access-9mxtv\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.415017 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.414924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6169a7c8-6149-41c8-8b99-61f49d40a0d5-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.415017 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.414941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fec1aca6-81f3-4b05-89be-89d80de7a406-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.415017 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.414963 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pxxm\" (UniqueName: \"kubernetes.io/projected/b02517af-8728-4ca9-b3de-1f7785e30ec9-kube-api-access-7pxxm\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:31.415017 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.414980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.415017 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-trusted-ca\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415044 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpd7b\" (UniqueName: \"kubernetes.io/projected/e1f10169-faf5-4ac3-a695-85d4a238de8f-kube-api-access-dpd7b\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-image-registry-private-configuration\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn444\" (UniqueName: \"kubernetes.io/projected/6169a7c8-6149-41c8-8b99-61f49d40a0d5-kube-api-access-sn444\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6169a7c8-6149-41c8-8b99-61f49d40a0d5-serving-cert\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415149 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6169a7c8-6149-41c8-8b99-61f49d40a0d5-snapshots\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415164 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/746d05c8-e84f-4fab-92a7-4dd04f4878f6-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f10169-faf5-4ac3-a695-85d4a238de8f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ec17a6d-115b-4ebb-ac14-ca396902c126-ca-trust-extracted\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/538669b7-54b4-4f39-b542-932532b0aede-config\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415251 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-stats-auth\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.415294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttqlt\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-kube-api-access-ttqlt\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415359 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/538669b7-54b4-4f39-b542-932532b0aede-trusted-ca\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqxwv\" (UniqueName: \"kubernetes.io/projected/746d05c8-e84f-4fab-92a7-4dd04f4878f6-kube-api-access-dqxwv\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-certificates\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415443 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415470 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xppx\" (UniqueName: \"kubernetes.io/projected/93c8b475-4fc6-4f2a-af38-bba514265f42-kube-api-access-6xppx\") pod \"volume-data-source-validator-549c6d54cf-htdpv\" (UID: \"93c8b475-4fc6-4f2a-af38-bba514265f42\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f10169-faf5-4ac3-a695-85d4a238de8f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6169a7c8-6149-41c8-8b99-61f49d40a0d5-service-ca-bundle\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415566 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fec1aca6-81f3-4b05-89be-89d80de7a406-config\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqxhw\" (UniqueName: \"kubernetes.io/projected/538669b7-54b4-4f39-b542-932532b0aede-kube-api-access-kqxhw\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-installation-pull-secrets\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415695 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6169a7c8-6149-41c8-8b99-61f49d40a0d5-tmp\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-bound-sa-token\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415744 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffkdl\" (UniqueName: \"kubernetes.io/projected/fec1aca6-81f3-4b05-89be-89d80de7a406-kube-api-access-ffkdl\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.415759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415766 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-default-certificate\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.416249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.415792 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/538669b7-54b4-4f39-b542-932532b0aede-serving-cert\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.497731 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.497691 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:31.516501 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/538669b7-54b4-4f39-b542-932532b0aede-trusted-ca\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.516691 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqxwv\" (UniqueName: \"kubernetes.io/projected/746d05c8-e84f-4fab-92a7-4dd04f4878f6-kube-api-access-dqxwv\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.516691 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516537 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-certificates\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.516691 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:31.516854 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516700 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xppx\" (UniqueName: \"kubernetes.io/projected/93c8b475-4fc6-4f2a-af38-bba514265f42-kube-api-access-6xppx\") pod \"volume-data-source-validator-549c6d54cf-htdpv\" (UID: \"93c8b475-4fc6-4f2a-af38-bba514265f42\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv" Jul 24 03:18:31.516854 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f10169-faf5-4ac3-a695-85d4a238de8f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.516854 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6169a7c8-6149-41c8-8b99-61f49d40a0d5-service-ca-bundle\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.516854 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fec1aca6-81f3-4b05-89be-89d80de7a406-config\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.516854 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqxhw\" (UniqueName: \"kubernetes.io/projected/538669b7-54b4-4f39-b542-932532b0aede-kube-api-access-kqxhw\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.517089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516867 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-installation-pull-secrets\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.517089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6169a7c8-6149-41c8-8b99-61f49d40a0d5-tmp\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.517089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-bound-sa-token\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.517089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffkdl\" (UniqueName: \"kubernetes.io/projected/fec1aca6-81f3-4b05-89be-89d80de7a406-kube-api-access-ffkdl\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.517089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.516979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-default-certificate\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.517089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/538669b7-54b4-4f39-b542-932532b0aede-serving-cert\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.517089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517041 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mxtv\" (UniqueName: \"kubernetes.io/projected/cb09d7be-7af6-49c0-bc46-5c27691156ce-kube-api-access-9mxtv\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.517089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n4wz\" (UniqueName: \"kubernetes.io/projected/68348238-a827-4623-a962-75d06e9c76e3-kube-api-access-7n4wz\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6169a7c8-6149-41c8-8b99-61f49d40a0d5-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fec1aca6-81f3-4b05-89be-89d80de7a406-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517151 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-certificates\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517157 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b3df521-c842-467d-a7b6-d9c089ff6119-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517216 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pxxm\" (UniqueName: \"kubernetes.io/projected/b02517af-8728-4ca9-b3de-1f7785e30ec9-kube-api-access-7pxxm\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9gf\" (UniqueName: \"kubernetes.io/projected/079af452-eef5-404b-91da-d8ad6c511629-kube-api-access-8l9gf\") pod \"ingress-canary-5c5zc\" (UID: \"079af452-eef5-404b-91da-d8ad6c511629\") " pod="openshift-ingress-canary/ingress-canary-5c5zc" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517270 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517308 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/538669b7-54b4-4f39-b542-932532b0aede-trusted-ca\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517347 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-trusted-ca\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517375 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpd7b\" (UniqueName: \"kubernetes.io/projected/e1f10169-faf5-4ac3-a695-85d4a238de8f-kube-api-access-dpd7b\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517395 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-image-registry-private-configuration\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.517404 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6fq9\" (UniqueName: \"kubernetes.io/projected/95da2033-597c-4884-ad45-1e84fbf5daca-kube-api-access-f6fq9\") pod \"network-check-source-7d88cb55d8-zt8zt\" (UID: \"95da2033-597c-4884-ad45-1e84fbf5daca\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517430 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68348238-a827-4623-a962-75d06e9c76e3-tmp-dir\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.517539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn444\" (UniqueName: \"kubernetes.io/projected/6169a7c8-6149-41c8-8b99-61f49d40a0d5-kube-api-access-sn444\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.517473 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls podName:746d05c8-e84f-4fab-92a7-4dd04f4878f6 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:32.017453838 +0000 UTC m=+35.592103767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lknbs" (UID: "746d05c8-e84f-4fab-92a7-4dd04f4878f6") : secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.517475 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517504 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6169a7c8-6149-41c8-8b99-61f49d40a0d5-service-ca-bundle\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6169a7c8-6149-41c8-8b99-61f49d40a0d5-serving-cert\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.517536 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls podName:b02517af-8728-4ca9-b3de-1f7785e30ec9 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:32.017519824 +0000 UTC m=+35.592169734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls") pod "cluster-samples-operator-6748489656-wfrvb" (UID: "b02517af-8728-4ca9-b3de-1f7785e30ec9") : secret "samples-operator-tls" not found Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517569 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517598 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68348238-a827-4623-a962-75d06e9c76e3-config-volume\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517646 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6169a7c8-6149-41c8-8b99-61f49d40a0d5-snapshots\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/746d05c8-e84f-4fab-92a7-4dd04f4878f6-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f10169-faf5-4ac3-a695-85d4a238de8f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ec17a6d-115b-4ebb-ac14-ca396902c126-ca-trust-extracted\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/538669b7-54b4-4f39-b542-932532b0aede-config\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517782 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-stats-auth\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517802 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.518193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517828 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttqlt\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-kube-api-access-ttqlt\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517848 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517869 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.517890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/079af452-eef5-404b-91da-d8ad6c511629-cert\") pod \"ingress-canary-5c5zc\" (UID: \"079af452-eef5-404b-91da-d8ad6c511629\") " pod="openshift-ingress-canary/ingress-canary-5c5zc" Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.518011 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.518200 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7f4d4684-cz5n2: secret "image-registry-tls" not found Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.518251 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls podName:7ec17a6d-115b-4ebb-ac14-ca396902c126 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:32.018236907 +0000 UTC m=+35.592886817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls") pod "image-registry-5d7f4d4684-cz5n2" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126") : secret "image-registry-tls" not found Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.518423 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-trusted-ca\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.518687 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6169a7c8-6149-41c8-8b99-61f49d40a0d5-snapshots\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.518934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.518775 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fec1aca6-81f3-4b05-89be-89d80de7a406-config\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.519390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.519039 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6169a7c8-6149-41c8-8b99-61f49d40a0d5-tmp\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.519390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.519110 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6169a7c8-6149-41c8-8b99-61f49d40a0d5-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.519805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.519779 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/746d05c8-e84f-4fab-92a7-4dd04f4878f6-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.520113 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.520094 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:32.020079028 +0000 UTC m=+35.594728960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : configmap references non-existent config key: service-ca.crt Jul 24 03:18:31.520624 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.520595 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ec17a6d-115b-4ebb-ac14-ca396902c126-ca-trust-extracted\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.521115 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.521086 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 03:18:31.521218 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.521141 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:32.02112608 +0000 UTC m=+35.595776004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : secret "router-metrics-certs-default" not found Jul 24 03:18:31.521312 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.521294 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1f10169-faf5-4ac3-a695-85d4a238de8f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.521807 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.521785 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/538669b7-54b4-4f39-b542-932532b0aede-config\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.523018 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.522996 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-image-registry-private-configuration\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.523233 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.523212 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fec1aca6-81f3-4b05-89be-89d80de7a406-serving-cert\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.523500 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.523469 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-stats-auth\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.523951 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.523871 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1f10169-faf5-4ac3-a695-85d4a238de8f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.524801 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.524429 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-default-certificate\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.524801 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.524445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-installation-pull-secrets\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.525896 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.525868 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/538669b7-54b4-4f39-b542-932532b0aede-serving-cert\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.526541 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.526517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6169a7c8-6149-41c8-8b99-61f49d40a0d5-serving-cert\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.527257 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.527238 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xppx\" (UniqueName: \"kubernetes.io/projected/93c8b475-4fc6-4f2a-af38-bba514265f42-kube-api-access-6xppx\") pod \"volume-data-source-validator-549c6d54cf-htdpv\" (UID: \"93c8b475-4fc6-4f2a-af38-bba514265f42\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv" Jul 24 03:18:31.527361 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.527259 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn444\" (UniqueName: \"kubernetes.io/projected/6169a7c8-6149-41c8-8b99-61f49d40a0d5-kube-api-access-sn444\") pod \"insights-operator-5885fdb759-5p6ql\" (UID: \"6169a7c8-6149-41c8-8b99-61f49d40a0d5\") " pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.527662 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.527623 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-bound-sa-token\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.528537 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.528511 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqxwv\" (UniqueName: \"kubernetes.io/projected/746d05c8-e84f-4fab-92a7-4dd04f4878f6-kube-api-access-dqxwv\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:31.530379 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.529883 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mxtv\" (UniqueName: \"kubernetes.io/projected/cb09d7be-7af6-49c0-bc46-5c27691156ce-kube-api-access-9mxtv\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:31.530379 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.530340 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpd7b\" (UniqueName: \"kubernetes.io/projected/e1f10169-faf5-4ac3-a695-85d4a238de8f-kube-api-access-dpd7b\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj\" (UID: \"e1f10169-faf5-4ac3-a695-85d4a238de8f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.531136 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.531114 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqxhw\" (UniqueName: \"kubernetes.io/projected/538669b7-54b4-4f39-b542-932532b0aede-kube-api-access-kqxhw\") pod \"console-operator-584dcb6b54-rs8hf\" (UID: \"538669b7-54b4-4f39-b542-932532b0aede\") " pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.531674 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.531641 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffkdl\" (UniqueName: \"kubernetes.io/projected/fec1aca6-81f3-4b05-89be-89d80de7a406-kube-api-access-ffkdl\") pod \"service-ca-operator-5d6c75f84f-9vrv8\" (UID: \"fec1aca6-81f3-4b05-89be-89d80de7a406\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.531787 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.531771 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttqlt\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-kube-api-access-ttqlt\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:31.532351 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.532333 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pxxm\" (UniqueName: \"kubernetes.io/projected/b02517af-8728-4ca9-b3de-1f7785e30ec9-kube-api-access-7pxxm\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:31.582345 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.582247 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:31.619225 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6fq9\" (UniqueName: \"kubernetes.io/projected/95da2033-597c-4884-ad45-1e84fbf5daca-kube-api-access-f6fq9\") pod \"network-check-source-7d88cb55d8-zt8zt\" (UID: \"95da2033-597c-4884-ad45-1e84fbf5daca\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt" Jul 24 03:18:31.619225 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68348238-a827-4623-a962-75d06e9c76e3-tmp-dir\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.619491 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68348238-a827-4623-a962-75d06e9c76e3-config-volume\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.619491 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.619491 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:31.619491 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/079af452-eef5-404b-91da-d8ad6c511629-cert\") pod \"ingress-canary-5c5zc\" (UID: \"079af452-eef5-404b-91da-d8ad6c511629\") " pod="openshift-ingress-canary/ingress-canary-5c5zc" Jul 24 03:18:31.619667 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619494 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n4wz\" (UniqueName: \"kubernetes.io/projected/68348238-a827-4623-a962-75d06e9c76e3-kube-api-access-7n4wz\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.619667 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b3df521-c842-467d-a7b6-d9c089ff6119-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:31.619667 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9gf\" (UniqueName: \"kubernetes.io/projected/079af452-eef5-404b-91da-d8ad6c511629-kube-api-access-8l9gf\") pod \"ingress-canary-5c5zc\" (UID: \"079af452-eef5-404b-91da-d8ad6c511629\") " pod="openshift-ingress-canary/ingress-canary-5c5zc" Jul 24 03:18:31.619964 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.619936 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68348238-a827-4623-a962-75d06e9c76e3-tmp-dir\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.620479 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.620456 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68348238-a827-4623-a962-75d06e9c76e3-config-volume\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.620569 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.620555 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 03:18:31.620631 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.620621 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls podName:68348238-a827-4623-a962-75d06e9c76e3 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:32.120603456 +0000 UTC m=+35.695253370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls") pod "dns-default-6jj77" (UID: "68348238-a827-4623-a962-75d06e9c76e3") : secret "dns-default-metrics-tls" not found Jul 24 03:18:31.620689 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.620642 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 03:18:31.620741 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:31.620714 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert podName:7b3df521-c842-467d-a7b6-d9c089ff6119 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:32.12069427 +0000 UTC m=+35.695344194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fn82q" (UID: "7b3df521-c842-467d-a7b6-d9c089ff6119") : secret "networking-console-plugin-cert" not found Jul 24 03:18:31.620878 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.620857 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7b3df521-c842-467d-a7b6-d9c089ff6119-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:31.622801 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.622777 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/079af452-eef5-404b-91da-d8ad6c511629-cert\") pod \"ingress-canary-5c5zc\" (UID: \"079af452-eef5-404b-91da-d8ad6c511629\") " pod="openshift-ingress-canary/ingress-canary-5c5zc" Jul 24 03:18:31.628522 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.628489 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9gf\" (UniqueName: \"kubernetes.io/projected/079af452-eef5-404b-91da-d8ad6c511629-kube-api-access-8l9gf\") pod \"ingress-canary-5c5zc\" (UID: \"079af452-eef5-404b-91da-d8ad6c511629\") " pod="openshift-ingress-canary/ingress-canary-5c5zc" Jul 24 03:18:31.629224 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.629207 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6fq9\" (UniqueName: \"kubernetes.io/projected/95da2033-597c-4884-ad45-1e84fbf5daca-kube-api-access-f6fq9\") pod \"network-check-source-7d88cb55d8-zt8zt\" (UID: \"95da2033-597c-4884-ad45-1e84fbf5daca\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt" Jul 24 03:18:31.629551 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.629529 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n4wz\" (UniqueName: \"kubernetes.io/projected/68348238-a827-4623-a962-75d06e9c76e3-kube-api-access-7n4wz\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:31.657840 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.657800 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" Jul 24 03:18:31.678550 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.678519 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-5p6ql" Jul 24 03:18:31.686092 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.686062 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv" Jul 24 03:18:31.694370 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.694339 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" Jul 24 03:18:31.715124 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.714856 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:31.723036 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.722849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt" Jul 24 03:18:31.747142 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.746740 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5c5zc" Jul 24 03:18:31.900582 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.897411 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj"] Jul 24 03:18:31.900582 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.899713 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:18:31.900582 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.899949 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:18:31.900921 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.900779 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:18:31.904000 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.903974 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ph9hg\"" Jul 24 03:18:31.909109 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.909087 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 03:18:31.909220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.909140 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w5g4d\"" Jul 24 03:18:31.909303 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.909087 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 03:18:31.939308 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.939226 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-5p6ql"] Jul 24 03:18:31.941455 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.941437 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv"] Jul 24 03:18:31.971623 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.971595 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8"] Jul 24 03:18:31.976910 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:18:31.976859 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec1aca6_81f3_4b05_89be_89d80de7a406.slice/crio-c0d2e8a854810fa39470685dd503babc8df2db8b28976398ca54ac3689fcccc7 WatchSource:0}: Error finding container c0d2e8a854810fa39470685dd503babc8df2db8b28976398ca54ac3689fcccc7: Status 404 returned error can't find the container with id c0d2e8a854810fa39470685dd503babc8df2db8b28976398ca54ac3689fcccc7 Jul 24 03:18:31.985237 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.985213 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-rs8hf"] Jul 24 03:18:31.998513 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:31.994513 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt"] Jul 24 03:18:31.998513 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:18:31.995463 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95da2033_597c_4884_ad45_1e84fbf5daca.slice/crio-76b534037f9f95482a9ad441f8cd7001fe677877ee770e63ef580de9f9279446 WatchSource:0}: Error finding container 76b534037f9f95482a9ad441f8cd7001fe677877ee770e63ef580de9f9279446: Status 404 returned error can't find the container with id 76b534037f9f95482a9ad441f8cd7001fe677877ee770e63ef580de9f9279446 Jul 24 03:18:32.018816 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.018783 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5c5zc"] Jul 24 03:18:32.022439 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:18:32.022408 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079af452_eef5_404b_91da_d8ad6c511629.slice/crio-68256bc1ef8652d39737816947284e2271dc72b1274b1dd99e51bc87eb494616 WatchSource:0}: Error finding container 68256bc1ef8652d39737816947284e2271dc72b1274b1dd99e51bc87eb494616: Status 404 returned error can't find the container with id 68256bc1ef8652d39737816947284e2271dc72b1274b1dd99e51bc87eb494616 Jul 24 03:18:32.025142 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.025121 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:32.025193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.025159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:32.025193 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.025187 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:32.025297 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.025238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:32.025342 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.025300 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:32.025413 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025400 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 03:18:32.025460 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025449 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls podName:b02517af-8728-4ca9-b3de-1f7785e30ec9 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:33.02543035 +0000 UTC m=+36.600080261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls") pod "cluster-samples-operator-6748489656-wfrvb" (UID: "b02517af-8728-4ca9-b3de-1f7785e30ec9") : secret "samples-operator-tls" not found Jul 24 03:18:32.025529 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025517 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 03:18:32.025570 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025557 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:33.025545689 +0000 UTC m=+36.600195600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : secret "router-metrics-certs-default" not found Jul 24 03:18:32.025636 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025623 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:32.025681 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025660 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls podName:746d05c8-e84f-4fab-92a7-4dd04f4878f6 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:33.02564948 +0000 UTC m=+36.600299589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lknbs" (UID: "746d05c8-e84f-4fab-92a7-4dd04f4878f6") : secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:32.025740 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025728 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 03:18:32.025772 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025743 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7f4d4684-cz5n2: secret "image-registry-tls" not found Jul 24 03:18:32.025810 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.025775 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls podName:7ec17a6d-115b-4ebb-ac14-ca396902c126 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:33.025765855 +0000 UTC m=+36.600415782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls") pod "image-registry-5d7f4d4684-cz5n2" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126") : secret "image-registry-tls" not found Jul 24 03:18:32.026151 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.026134 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:33.026117151 +0000 UTC m=+36.600767064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : configmap references non-existent config key: service-ca.crt Jul 24 03:18:32.125898 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.125809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:32.125898 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.125875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:32.126094 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.125973 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 03:18:32.126094 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.126042 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 03:18:32.126094 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.126049 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls podName:68348238-a827-4623-a962-75d06e9c76e3 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:33.126029133 +0000 UTC m=+36.700679045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls") pod "dns-default-6jj77" (UID: "68348238-a827-4623-a962-75d06e9c76e3") : secret "dns-default-metrics-tls" not found Jul 24 03:18:32.126242 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:32.126113 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert podName:7b3df521-c842-467d-a7b6-d9c089ff6119 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:33.12609637 +0000 UTC m=+36.700746281 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fn82q" (UID: "7b3df521-c842-467d-a7b6-d9c089ff6119") : secret "networking-console-plugin-cert" not found Jul 24 03:18:32.171491 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.171453 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt" event={"ID":"95da2033-597c-4884-ad45-1e84fbf5daca","Type":"ContainerStarted","Data":"76b534037f9f95482a9ad441f8cd7001fe677877ee770e63ef580de9f9279446"} Jul 24 03:18:32.172744 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.172686 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" event={"ID":"538669b7-54b4-4f39-b542-932532b0aede","Type":"ContainerStarted","Data":"796529661d5bcf17b4e9c36aa480075a8550593170f53969b52d7e6f9c61edc8"} Jul 24 03:18:32.173972 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.173949 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" event={"ID":"fec1aca6-81f3-4b05-89be-89d80de7a406","Type":"ContainerStarted","Data":"c0d2e8a854810fa39470685dd503babc8df2db8b28976398ca54ac3689fcccc7"} Jul 24 03:18:32.175217 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.175196 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv" event={"ID":"93c8b475-4fc6-4f2a-af38-bba514265f42","Type":"ContainerStarted","Data":"f3a9b1ca9d811c0f585cf08524ca6c466d749e6c5b73f7a52408f92600793b50"} Jul 24 03:18:32.176477 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.176449 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" event={"ID":"e1f10169-faf5-4ac3-a695-85d4a238de8f","Type":"ContainerStarted","Data":"154e12b577c5991ee605f10053f2ab9cb49b58680f5e21d8d89eb4575eaa09d3"} Jul 24 03:18:32.177583 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.177560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5c5zc" event={"ID":"079af452-eef5-404b-91da-d8ad6c511629","Type":"ContainerStarted","Data":"68256bc1ef8652d39737816947284e2271dc72b1274b1dd99e51bc87eb494616"} Jul 24 03:18:32.178585 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:32.178558 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-5p6ql" event={"ID":"6169a7c8-6149-41c8-8b99-61f49d40a0d5","Type":"ContainerStarted","Data":"bb6fb627764f37ca2fb3f9887a26b6710ffa8480f974a8a95be17cd8429af8a7"} Jul 24 03:18:33.033660 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:33.033462 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:33.033729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.033641 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.033762 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7f4d4684-cz5n2: secret "image-registry-tls" not found Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:33.033775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.033834 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls podName:7ec17a6d-115b-4ebb-ac14-ca396902c126 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:35.033814879 +0000 UTC m=+38.608464803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls") pod "image-registry-5d7f4d4684-cz5n2" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126") : secret "image-registry-tls" not found Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.033873 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:35.03385541 +0000 UTC m=+38.608505325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : configmap references non-existent config key: service-ca.crt Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.033892 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.033933 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls podName:b02517af-8728-4ca9-b3de-1f7785e30ec9 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:35.033922767 +0000 UTC m=+38.608572681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls") pod "cluster-samples-operator-6748489656-wfrvb" (UID: "b02517af-8728-4ca9-b3de-1f7785e30ec9") : secret "samples-operator-tls" not found Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:33.033966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:33.034002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.034103 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.034141 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls podName:746d05c8-e84f-4fab-92a7-4dd04f4878f6 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:35.034129065 +0000 UTC m=+38.608778976 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lknbs" (UID: "746d05c8-e84f-4fab-92a7-4dd04f4878f6") : secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.034170 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 03:18:33.034386 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.034208 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:35.034198215 +0000 UTC m=+38.608848125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : secret "router-metrics-certs-default" not found Jul 24 03:18:33.134691 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:33.134648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:33.134849 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:33.134702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:33.134849 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.134815 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 03:18:33.134849 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.134822 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 03:18:33.135004 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.134877 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert podName:7b3df521-c842-467d-a7b6-d9c089ff6119 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:35.13486188 +0000 UTC m=+38.709511789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fn82q" (UID: "7b3df521-c842-467d-a7b6-d9c089ff6119") : secret "networking-console-plugin-cert" not found Jul 24 03:18:33.135004 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:33.134891 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls podName:68348238-a827-4623-a962-75d06e9c76e3 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:35.134884719 +0000 UTC m=+38.709534629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls") pod "dns-default-6jj77" (UID: "68348238-a827-4623-a962-75d06e9c76e3") : secret "dns-default-metrics-tls" not found Jul 24 03:18:34.196387 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:34.195465 2559 generic.go:356] "Generic (PLEG): container finished" podID="80fba38e-bd9b-4743-9a32-14fd65113fbe" containerID="172020eb66b2103cf9f2c11cd47236f5325c039f6b43c5e67a1f76759c1691c7" exitCode=0 Jul 24 03:18:34.196387 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:34.195523 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerDied","Data":"172020eb66b2103cf9f2c11cd47236f5325c039f6b43c5e67a1f76759c1691c7"} Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.061012 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.061077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.061123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.061198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.061245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.061441 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.061504 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls podName:b02517af-8728-4ca9-b3de-1f7785e30ec9 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:39.061486002 +0000 UTC m=+42.636135926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls") pod "cluster-samples-operator-6748489656-wfrvb" (UID: "b02517af-8728-4ca9-b3de-1f7785e30ec9") : secret "samples-operator-tls" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.062010 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.062063 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:39.062048096 +0000 UTC m=+42.636698009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : secret "router-metrics-certs-default" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.062118 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.062150 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls podName:746d05c8-e84f-4fab-92a7-4dd04f4878f6 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:39.062139033 +0000 UTC m=+42.636788960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lknbs" (UID: "746d05c8-e84f-4fab-92a7-4dd04f4878f6") : secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.062207 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.062230 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7f4d4684-cz5n2: secret "image-registry-tls" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.062262 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls podName:7ec17a6d-115b-4ebb-ac14-ca396902c126 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:39.062251607 +0000 UTC m=+42.636901519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls") pod "image-registry-5d7f4d4684-cz5n2" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126") : secret "image-registry-tls" not found Jul 24 03:18:35.062428 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.062342 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:39.062332257 +0000 UTC m=+42.636982187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : configmap references non-existent config key: service-ca.crt Jul 24 03:18:35.161942 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.161913 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:35.162104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.161957 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:35.162104 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.162089 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 03:18:35.162244 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.162140 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 03:18:35.162244 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.162189 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls podName:68348238-a827-4623-a962-75d06e9c76e3 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:39.16216011 +0000 UTC m=+42.736810034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls") pod "dns-default-6jj77" (UID: "68348238-a827-4623-a962-75d06e9c76e3") : secret "dns-default-metrics-tls" not found Jul 24 03:18:35.162244 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:35.162232 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert podName:7b3df521-c842-467d-a7b6-d9c089ff6119 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:39.162199837 +0000 UTC m=+42.736849747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fn82q" (UID: "7b3df521-c842-467d-a7b6-d9c089ff6119") : secret "networking-console-plugin-cert" not found Jul 24 03:18:35.213837 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.212902 2559 generic.go:356] "Generic (PLEG): container finished" podID="80fba38e-bd9b-4743-9a32-14fd65113fbe" containerID="5fd7e7ff531d8c32adaa6b7f83282f7aa3b412a9dec97a802dec2830c6b97855" exitCode=0 Jul 24 03:18:35.213837 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.212961 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerDied","Data":"5fd7e7ff531d8c32adaa6b7f83282f7aa3b412a9dec97a802dec2830c6b97855"} Jul 24 03:18:35.403613 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.403530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:35.503088 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:35.502965 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:36.220875 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:36.220828 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" event={"ID":"80fba38e-bd9b-4743-9a32-14fd65113fbe","Type":"ContainerStarted","Data":"40714f6d8a78aed1adac980a33e98497856f7af6b8a339e4f01fb66e61d34b13"} Jul 24 03:18:36.243728 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:36.243679 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xx9vb" podStartSLOduration=7.769230333 podStartE2EDuration="39.243661055s" totalImagesPullingTime="31.474430722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:36.241627418 +0000 UTC m=+39.816277349" watchObservedRunningTime="2026-07-24 03:18:36.243661055 +0000 UTC m=+39.818310989" Jul 24 03:18:36.365388 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:36.365351 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:36.468481 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:36.468435 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:38.185372 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:38.185331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:38.243596 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:38.243562 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:39.102461 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:39.102425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:39.102624 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:39.102499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:39.102624 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:39.102520 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:39.102624 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:39.102547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:39.102624 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102580 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 03:18:39.102624 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:39.102595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102643 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102659 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102664 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls podName:b02517af-8728-4ca9-b3de-1f7785e30ec9 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:47.102642634 +0000 UTC m=+50.677292561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls") pod "cluster-samples-operator-6748489656-wfrvb" (UID: "b02517af-8728-4ca9-b3de-1f7785e30ec9") : secret "samples-operator-tls" not found Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102703 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102720 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7f4d4684-cz5n2: secret "image-registry-tls" not found Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102742 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:47.102705668 +0000 UTC m=+50.677355593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : secret "router-metrics-certs-default" not found Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102767 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls podName:746d05c8-e84f-4fab-92a7-4dd04f4878f6 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:47.102756456 +0000 UTC m=+50.677406378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lknbs" (UID: "746d05c8-e84f-4fab-92a7-4dd04f4878f6") : secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102783 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:18:47.102774601 +0000 UTC m=+50.677424516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : configmap references non-existent config key: service-ca.crt Jul 24 03:18:39.102838 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.102797 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls podName:7ec17a6d-115b-4ebb-ac14-ca396902c126 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:47.102789087 +0000 UTC m=+50.677439003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls") pod "image-registry-5d7f4d4684-cz5n2" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126") : secret "image-registry-tls" not found Jul 24 03:18:39.203463 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:39.203430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:39.203919 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:39.203485 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:39.203919 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.203599 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 03:18:39.203919 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.203674 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls podName:68348238-a827-4623-a962-75d06e9c76e3 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:47.203658548 +0000 UTC m=+50.778308458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls") pod "dns-default-6jj77" (UID: "68348238-a827-4623-a962-75d06e9c76e3") : secret "dns-default-metrics-tls" not found Jul 24 03:18:39.203919 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.203602 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 03:18:39.203919 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:39.203721 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert podName:7b3df521-c842-467d-a7b6-d9c089ff6119 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:47.203710959 +0000 UTC m=+50.778360869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fn82q" (UID: "7b3df521-c842-467d-a7b6-d9c089ff6119") : secret "networking-console-plugin-cert" not found Jul 24 03:18:39.916538 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:39.916500 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:40.017867 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:40.017830 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" limit=1024 Jul 24 03:18:42.238199 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.238009 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-5p6ql" event={"ID":"6169a7c8-6149-41c8-8b99-61f49d40a0d5","Type":"ContainerStarted","Data":"87a1c963a1f85b91104299c325f7347899dfa759ab7704d0c8890913a40fd5ca"} Jul 24 03:18:42.239588 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.239560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt" event={"ID":"95da2033-597c-4884-ad45-1e84fbf5daca","Type":"ContainerStarted","Data":"2f6885fd3a822cc97403e3b00b6acd11a26e6187122a647417a1f43aaf56c3f8"} Jul 24 03:18:42.241455 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.241433 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/0.log" Jul 24 03:18:42.241566 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.241469 2559 generic.go:356] "Generic (PLEG): container finished" podID="538669b7-54b4-4f39-b542-932532b0aede" containerID="27876583204a1cc8269bc935fcf9dd02519ff9452919abd9ddd56de2bc5206e8" exitCode=255 Jul 24 03:18:42.241683 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.241663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" event={"ID":"538669b7-54b4-4f39-b542-932532b0aede","Type":"ContainerDied","Data":"27876583204a1cc8269bc935fcf9dd02519ff9452919abd9ddd56de2bc5206e8"} Jul 24 03:18:42.241799 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.241779 2559 scope.go:117] "RemoveContainer" containerID="27876583204a1cc8269bc935fcf9dd02519ff9452919abd9ddd56de2bc5206e8" Jul 24 03:18:42.243531 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.243170 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" event={"ID":"fec1aca6-81f3-4b05-89be-89d80de7a406","Type":"ContainerStarted","Data":"2def37a2283a2f80d47c9c635b7fd8e99e41f41f8735e0ae388cdca5ad9dec07"} Jul 24 03:18:42.244701 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.244657 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv" event={"ID":"93c8b475-4fc6-4f2a-af38-bba514265f42","Type":"ContainerStarted","Data":"ff0c9f26060cb0c41bb5f9c7960cf65d3cb09f9c8bee807ea4e501958ab6cfc7"} Jul 24 03:18:42.246399 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.246368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" event={"ID":"e1f10169-faf5-4ac3-a695-85d4a238de8f","Type":"ContainerStarted","Data":"388c0af5fa51c1370d90b7471b7c8032e7567d1887e7cb18f83311c7bd42db6e"} Jul 24 03:18:42.248127 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.248105 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5c5zc" event={"ID":"079af452-eef5-404b-91da-d8ad6c511629","Type":"ContainerStarted","Data":"df1201eb72d302bd0bdc76da889a491ffe97433425f77d97cfaafce7a4325d64"} Jul 24 03:18:42.283699 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.283584 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" podStartSLOduration=35.846176447 podStartE2EDuration="45.283561994s" totalImagesPullingTime="9.437385547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:42.282670388 +0000 UTC m=+45.857320323" watchObservedRunningTime="2026-07-24 03:18:42.283561994 +0000 UTC m=+45.858211930" Jul 24 03:18:42.283852 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.283698 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-5p6ql" podStartSLOduration=35.862443717 podStartE2EDuration="45.283688611s" totalImagesPullingTime="9.421244894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:42.261694564 +0000 UTC m=+45.836344523" watchObservedRunningTime="2026-07-24 03:18:42.283688611 +0000 UTC m=+45.858338545" Jul 24 03:18:42.301601 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.300975 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-zt8zt" podStartSLOduration=34.932323015 podStartE2EDuration="44.300955738s" totalImagesPullingTime="9.368632723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:42.300495334 +0000 UTC m=+45.875145269" watchObservedRunningTime="2026-07-24 03:18:42.300955738 +0000 UTC m=+45.875605675" Jul 24 03:18:42.322994 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.322939 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" podStartSLOduration=35.933261164 podStartE2EDuration="45.322918839s" totalImagesPullingTime="9.389657675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:42.321546128 +0000 UTC m=+45.896196058" watchObservedRunningTime="2026-07-24 03:18:42.322918839 +0000 UTC m=+45.897568774" Jul 24 03:18:42.376735 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.376620 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5c5zc" podStartSLOduration=2.032708232 podStartE2EDuration="11.376598518s" totalImagesPullingTime="9.343890286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:42.374573768 +0000 UTC m=+45.949223700" watchObservedRunningTime="2026-07-24 03:18:42.376598518 +0000 UTC m=+45.951248450" Jul 24 03:18:42.391445 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.391360 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-htdpv" podStartSLOduration=36.091676884 podStartE2EDuration="45.391337304s" totalImagesPullingTime="9.29966042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:42.390766373 +0000 UTC m=+45.965416304" watchObservedRunningTime="2026-07-24 03:18:42.391337304 +0000 UTC m=+45.965987237" Jul 24 03:18:42.478701 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.478667 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xr826"] Jul 24 03:18:42.493226 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.492847 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.494557 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.494521 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xr826"] Jul 24 03:18:42.496101 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.495838 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 03:18:42.496101 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.495874 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 03:18:42.496101 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.495843 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmhzr\"" Jul 24 03:18:42.537148 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.537106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.537321 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.537192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4496x\" (UniqueName: \"kubernetes.io/projected/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-api-access-4496x\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.537321 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.537244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-crio-socket\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.537430 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.537415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.537491 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.537476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-data-volume\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.638724 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.638675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.638950 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.638761 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-data-volume\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.638950 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.638795 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.638950 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:42.638814 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 03:18:42.638950 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.638842 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4496x\" (UniqueName: \"kubernetes.io/projected/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-api-access-4496x\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.638950 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.638868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-crio-socket\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.638950 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:42.638891 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:43.138870124 +0000 UTC m=+46.713520052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : configmap "kube-rbac-proxy" not found Jul 24 03:18:42.639205 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.639035 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-crio-socket\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.639205 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:42.639134 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 03:18:42.639309 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:42.639206 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:43.139189896 +0000 UTC m=+46.713839809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : secret "insights-runtime-extractor-tls" not found Jul 24 03:18:42.639486 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.639465 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-data-volume\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:42.649778 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:42.649752 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4496x\" (UniqueName: \"kubernetes.io/projected/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-api-access-4496x\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:43.143085 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.143047 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:43.143258 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.143150 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:43.143258 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:43.143187 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 03:18:43.143430 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:43.143270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:44.143249368 +0000 UTC m=+47.717899284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : configmap "kube-rbac-proxy" not found Jul 24 03:18:43.143430 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:43.143337 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 03:18:43.143430 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:43.143407 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:44.143390077 +0000 UTC m=+47.718039993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : secret "insights-runtime-extractor-tls" not found Jul 24 03:18:43.253640 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.253611 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:18:43.254097 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.254079 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/0.log" Jul 24 03:18:43.254146 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.254123 2559 generic.go:356] "Generic (PLEG): container finished" podID="538669b7-54b4-4f39-b542-932532b0aede" containerID="74a7bf8158c472521b728eb2749ca1a2990edc00260e4e89476105bd7260a5b8" exitCode=255 Jul 24 03:18:43.254264 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.254224 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" event={"ID":"538669b7-54b4-4f39-b542-932532b0aede","Type":"ContainerDied","Data":"74a7bf8158c472521b728eb2749ca1a2990edc00260e4e89476105bd7260a5b8"} Jul 24 03:18:43.254405 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.254334 2559 scope.go:117] "RemoveContainer" containerID="27876583204a1cc8269bc935fcf9dd02519ff9452919abd9ddd56de2bc5206e8" Jul 24 03:18:43.254528 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.254468 2559 scope.go:117] "RemoveContainer" containerID="74a7bf8158c472521b728eb2749ca1a2990edc00260e4e89476105bd7260a5b8" Jul 24 03:18:43.254701 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:43.254678 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-rs8hf_openshift-console-operator(538669b7-54b4-4f39-b542-932532b0aede)\"" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" podUID="538669b7-54b4-4f39-b542-932532b0aede" Jul 24 03:18:43.649611 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.649583 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8k4p_035aef4d-c1ba-4acf-abe0-00149bc69aaa/dns-node-resolver/0.log" Jul 24 03:18:43.777557 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.777529 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv"] Jul 24 03:18:43.809030 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.809000 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv"] Jul 24 03:18:43.809201 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.809127 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" Jul 24 03:18:43.811937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.811915 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fmlxl\"" Jul 24 03:18:43.811937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.811918 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 03:18:43.812115 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.811970 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 03:18:43.851942 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.851909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7zdf\" (UniqueName: \"kubernetes.io/projected/0e049f70-2d0d-4423-ad57-5be0c28756b8-kube-api-access-p7zdf\") pod \"migrator-6865c9967-ll9pv\" (UID: \"0e049f70-2d0d-4423-ad57-5be0c28756b8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" Jul 24 03:18:43.952833 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.952742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zdf\" (UniqueName: \"kubernetes.io/projected/0e049f70-2d0d-4423-ad57-5be0c28756b8-kube-api-access-p7zdf\") pod \"migrator-6865c9967-ll9pv\" (UID: \"0e049f70-2d0d-4423-ad57-5be0c28756b8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" Jul 24 03:18:43.961222 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:43.961194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7zdf\" (UniqueName: \"kubernetes.io/projected/0e049f70-2d0d-4423-ad57-5be0c28756b8-kube-api-access-p7zdf\") pod \"migrator-6865c9967-ll9pv\" (UID: \"0e049f70-2d0d-4423-ad57-5be0c28756b8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" Jul 24 03:18:44.119206 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:44.119178 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" Jul 24 03:18:44.155560 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:44.155534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:44.155710 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:44.155696 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 03:18:44.155750 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:44.155741 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 03:18:44.155790 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:44.155697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:44.155790 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:44.155767 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:46.15574801 +0000 UTC m=+49.730397920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : secret "insights-runtime-extractor-tls" not found Jul 24 03:18:44.155790 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:44.155787 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:46.155778128 +0000 UTC m=+49.730428039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : configmap "kube-rbac-proxy" not found Jul 24 03:18:44.258216 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:44.258189 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:18:44.258669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:44.258598 2559 scope.go:117] "RemoveContainer" containerID="74a7bf8158c472521b728eb2749ca1a2990edc00260e4e89476105bd7260a5b8" Jul 24 03:18:44.258798 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:44.258776 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-rs8hf_openshift-console-operator(538669b7-54b4-4f39-b542-932532b0aede)\"" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" podUID="538669b7-54b4-4f39-b542-932532b0aede" Jul 24 03:18:44.263262 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:44.263195 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv"] Jul 24 03:18:44.265843 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:18:44.265817 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e049f70_2d0d_4423_ad57_5be0c28756b8.slice/crio-2a6230276fb89790fd4bea93fe7c5ff85cc70c9213eaa0311fbd6907945fd4ee WatchSource:0}: Error finding container 2a6230276fb89790fd4bea93fe7c5ff85cc70c9213eaa0311fbd6907945fd4ee: Status 404 returned error can't find the container with id 2a6230276fb89790fd4bea93fe7c5ff85cc70c9213eaa0311fbd6907945fd4ee Jul 24 03:18:44.447031 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:44.447004 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2gfsv_2d202ea7-a61f-4339-817b-2c19f914f343/node-ca/0.log" Jul 24 03:18:45.246795 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:45.246766 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5c5zc_079af452-eef5-404b-91da-d8ad6c511629/serve-healthcheck-canary/0.log" Jul 24 03:18:45.263088 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:45.263048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" event={"ID":"0e049f70-2d0d-4423-ad57-5be0c28756b8","Type":"ContainerStarted","Data":"2a6230276fb89790fd4bea93fe7c5ff85cc70c9213eaa0311fbd6907945fd4ee"} Jul 24 03:18:45.983808 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:45.983781 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-lwbtz"] Jul 24 03:18:45.996564 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:45.996540 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-lwbtz"] Jul 24 03:18:45.996678 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:45.996664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:45.999375 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:45.999351 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 24 03:18:45.999489 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:45.999382 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 24 03:18:46.000212 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.000190 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 24 03:18:46.000321 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.000193 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nt5dh\"" Jul 24 03:18:46.000321 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.000234 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 24 03:18:46.074761 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.074684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-signing-key\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.074905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.074770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-signing-cabundle\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.074905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.074881 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghrkg\" (UniqueName: \"kubernetes.io/projected/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-kube-api-access-ghrkg\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.175935 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.175909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghrkg\" (UniqueName: \"kubernetes.io/projected/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-kube-api-access-ghrkg\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.176073 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.175977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:46.176073 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.176016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-signing-key\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.176073 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.176063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-signing-cabundle\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.176245 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.176133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:46.176245 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:46.176135 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 03:18:46.176245 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:46.176201 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:50.176179565 +0000 UTC m=+53.750829477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : secret "insights-runtime-extractor-tls" not found Jul 24 03:18:46.176245 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:46.176215 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 24 03:18:46.176441 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:46.176263 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:50.176248783 +0000 UTC m=+53.750898693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : configmap "kube-rbac-proxy" not found Jul 24 03:18:46.176785 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.176763 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-signing-cabundle\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.178575 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.178559 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-signing-key\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.184643 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.184619 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghrkg\" (UniqueName: \"kubernetes.io/projected/abeff0dd-0a43-4c2f-853b-eff2f4feacb8-kube-api-access-ghrkg\") pod \"service-ca-658d7b7c78-lwbtz\" (UID: \"abeff0dd-0a43-4c2f-853b-eff2f4feacb8\") " pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.268718 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.268681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" event={"ID":"0e049f70-2d0d-4423-ad57-5be0c28756b8","Type":"ContainerStarted","Data":"af51e3808d079532e6f3d9af3cd3d6d71076b861c6ef3a23ba4d89530dff2f8b"} Jul 24 03:18:46.269090 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.268730 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" event={"ID":"0e049f70-2d0d-4423-ad57-5be0c28756b8","Type":"ContainerStarted","Data":"d28d626792ee788d1dd456b70b3f5bdfb40bc87b058507c0f6a0c69e5008150a"} Jul 24 03:18:46.283416 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.283372 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-ll9pv" podStartSLOduration=1.786808639 podStartE2EDuration="3.283358054s" totalImagesPullingTime="1.496549415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:46.282927656 +0000 UTC m=+49.857577591" watchObservedRunningTime="2026-07-24 03:18:46.283358054 +0000 UTC m=+49.858007985" Jul 24 03:18:46.320710 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.320682 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" Jul 24 03:18:46.453485 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:46.453460 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-lwbtz"] Jul 24 03:18:46.455865 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:18:46.455836 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabeff0dd_0a43_4c2f_853b_eff2f4feacb8.slice/crio-7100fdf0e4ee2b063635243957fe2a49758b7182abaabe5db3da1be6511cf3b7 WatchSource:0}: Error finding container 7100fdf0e4ee2b063635243957fe2a49758b7182abaabe5db3da1be6511cf3b7: Status 404 returned error can't find the container with id 7100fdf0e4ee2b063635243957fe2a49758b7182abaabe5db3da1be6511cf3b7 Jul 24 03:18:47.185610 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.185574 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:47.185815 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.185623 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:18:47.185815 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.185687 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:18:47.185815 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.185766 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 24 03:18:47.185815 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.185772 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:19:03.185750855 +0000 UTC m=+66.760400766 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : configmap references non-existent config key: service-ca.crt Jul 24 03:18:47.185815 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.185811 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs podName:cb09d7be-7af6-49c0-bc46-5c27691156ce nodeName:}" failed. No retries permitted until 2026-07-24 03:19:03.185800819 +0000 UTC m=+66.760450728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs") pod "router-default-67f88b97c-dvxwx" (UID: "cb09d7be-7af6-49c0-bc46-5c27691156ce") : secret "router-metrics-certs-default" not found Jul 24 03:18:47.185815 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.185812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:18:47.186074 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.185823 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 24 03:18:47.186074 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.185883 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls podName:b02517af-8728-4ca9-b3de-1f7785e30ec9 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:03.185871687 +0000 UTC m=+66.760521604 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls") pod "cluster-samples-operator-6748489656-wfrvb" (UID: "b02517af-8728-4ca9-b3de-1f7785e30ec9") : secret "samples-operator-tls" not found Jul 24 03:18:47.186074 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.185898 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:47.186074 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.185925 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls podName:746d05c8-e84f-4fab-92a7-4dd04f4878f6 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:03.185914812 +0000 UTC m=+66.760564722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-lknbs" (UID: "746d05c8-e84f-4fab-92a7-4dd04f4878f6") : secret "cluster-monitoring-operator-tls" not found Jul 24 03:18:47.186074 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.185922 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:18:47.186074 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.185989 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 24 03:18:47.186074 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.186005 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d7f4d4684-cz5n2: secret "image-registry-tls" not found Jul 24 03:18:47.186074 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.186048 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls podName:7ec17a6d-115b-4ebb-ac14-ca396902c126 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:03.186035907 +0000 UTC m=+66.760685819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls") pod "image-registry-5d7f4d4684-cz5n2" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126") : secret "image-registry-tls" not found Jul 24 03:18:47.277293 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.276742 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" event={"ID":"abeff0dd-0a43-4c2f-853b-eff2f4feacb8","Type":"ContainerStarted","Data":"17ae95ecc561fa18016e2f6e01b338c139882c95ed20422a2085080cad8ee9a3"} Jul 24 03:18:47.277293 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.276849 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" event={"ID":"abeff0dd-0a43-4c2f-853b-eff2f4feacb8","Type":"ContainerStarted","Data":"7100fdf0e4ee2b063635243957fe2a49758b7182abaabe5db3da1be6511cf3b7"} Jul 24 03:18:47.287253 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.287223 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:18:47.287393 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.287290 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:18:47.287448 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.287402 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 24 03:18:47.287448 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.287405 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 03:18:47.287562 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.287459 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert podName:7b3df521-c842-467d-a7b6-d9c089ff6119 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:03.287439835 +0000 UTC m=+66.862089749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fn82q" (UID: "7b3df521-c842-467d-a7b6-d9c089ff6119") : secret "networking-console-plugin-cert" not found Jul 24 03:18:47.287562 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:47.287480 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls podName:68348238-a827-4623-a962-75d06e9c76e3 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:03.287471591 +0000 UTC m=+66.862121501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls") pod "dns-default-6jj77" (UID: "68348238-a827-4623-a962-75d06e9c76e3") : secret "dns-default-metrics-tls" not found Jul 24 03:18:47.293088 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:47.293049 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-lwbtz" podStartSLOduration=2.293035225 podStartE2EDuration="2.293035225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:18:47.291896516 +0000 UTC m=+50.866546465" watchObservedRunningTime="2026-07-24 03:18:47.293035225 +0000 UTC m=+50.867685203" Jul 24 03:18:50.218800 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:50.218766 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:50.219253 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:50.218832 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:50.219253 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:50.218940 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 03:18:50.219253 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:50.218998 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls podName:d7c8f9d5-ef5f-438e-87cc-72d0a6926423 nodeName:}" failed. No retries permitted until 2026-07-24 03:18:58.218982369 +0000 UTC m=+61.793632280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xr826" (UID: "d7c8f9d5-ef5f-438e-87cc-72d0a6926423") : secret "insights-runtime-extractor-tls" not found Jul 24 03:18:50.219403 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:50.219341 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:51.715991 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:51.715950 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:51.716602 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:51.716019 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:18:51.716602 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:51.716485 2559 scope.go:117] "RemoveContainer" containerID="74a7bf8158c472521b728eb2749ca1a2990edc00260e4e89476105bd7260a5b8" Jul 24 03:18:51.716722 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:18:51.716686 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-rs8hf_openshift-console-operator(538669b7-54b4-4f39-b542-932532b0aede)\"" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" podUID="538669b7-54b4-4f39-b542-932532b0aede" Jul 24 03:18:57.171527 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:57.171494 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2bqmc" Jul 24 03:18:58.299502 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:58.299461 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:58.301861 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:58.301837 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d7c8f9d5-ef5f-438e-87cc-72d0a6926423-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xr826\" (UID: \"d7c8f9d5-ef5f-438e-87cc-72d0a6926423\") " pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:58.406913 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:58.406888 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tmhzr\"" Jul 24 03:18:58.414791 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:58.414765 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xr826" Jul 24 03:18:58.541581 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:58.541423 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xr826"] Jul 24 03:18:58.544017 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:18:58.543993 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c8f9d5_ef5f_438e_87cc_72d0a6926423.slice/crio-55e9fca7f9b5ffcd8d03479411752caa122fbfe5cdd1110d1b998a26db861e08 WatchSource:0}: Error finding container 55e9fca7f9b5ffcd8d03479411752caa122fbfe5cdd1110d1b998a26db861e08: Status 404 returned error can't find the container with id 55e9fca7f9b5ffcd8d03479411752caa122fbfe5cdd1110d1b998a26db861e08 Jul 24 03:18:59.325886 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:18:59.325795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr826" event={"ID":"d7c8f9d5-ef5f-438e-87cc-72d0a6926423","Type":"ContainerStarted","Data":"55e9fca7f9b5ffcd8d03479411752caa122fbfe5cdd1110d1b998a26db861e08"} Jul 24 03:19:01.634342 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.634269 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:19:01.634753 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.634398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:19:01.636931 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.636903 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 03:19:01.637085 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.636960 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 03:19:01.647931 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.647901 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22cf01fa-32a1-49b0-9722-d3fbd4fcb738-original-pull-secret\") pod \"global-pull-secret-syncer-b25hj\" (UID: \"22cf01fa-32a1-49b0-9722-d3fbd4fcb738\") " pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:19:01.648084 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.647902 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/434d1dd7-7bea-4781-b385-eeed01587e4a-metrics-certs\") pod \"network-metrics-daemon-qtwg5\" (UID: \"434d1dd7-7bea-4781-b385-eeed01587e4a\") " pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:19:01.657012 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.656964 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b25hj" Jul 24 03:19:01.735285 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.735251 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:19:01.738046 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.738017 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzgtg\" (UniqueName: \"kubernetes.io/projected/58390921-c114-4dd6-a334-c3ecadf82534-kube-api-access-qzgtg\") pod \"network-check-target-ktlcb\" (UID: \"58390921-c114-4dd6-a334-c3ecadf82534\") " pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:19:01.928117 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.928041 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w5g4d\"" Jul 24 03:19:01.935858 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.935830 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:19:01.949912 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.949881 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ph9hg\"" Jul 24 03:19:01.957361 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:01.957334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtwg5" Jul 24 03:19:03.248969 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.248930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:03.249562 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.248998 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:19:03.249562 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.249052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:03.249562 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.249070 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:19:03.249562 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.249107 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:19:03.249801 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.249773 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb09d7be-7af6-49c0-bc46-5c27691156ce-service-ca-bundle\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:03.252006 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.251972 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/746d05c8-e84f-4fab-92a7-4dd04f4878f6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-lknbs\" (UID: \"746d05c8-e84f-4fab-92a7-4dd04f4878f6\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:19:03.252130 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.252015 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"image-registry-5d7f4d4684-cz5n2\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:19:03.252130 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.252075 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b02517af-8728-4ca9-b3de-1f7785e30ec9-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wfrvb\" (UID: \"b02517af-8728-4ca9-b3de-1f7785e30ec9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:19:03.252603 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.252587 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb09d7be-7af6-49c0-bc46-5c27691156ce-metrics-certs\") pod \"router-default-67f88b97c-dvxwx\" (UID: \"cb09d7be-7af6-49c0-bc46-5c27691156ce\") " pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:03.350360 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.350319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:19:03.350360 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.350373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:19:03.353447 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.353415 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68348238-a827-4623-a962-75d06e9c76e3-metrics-tls\") pod \"dns-default-6jj77\" (UID: \"68348238-a827-4623-a962-75d06e9c76e3\") " pod="openshift-dns/dns-default-6jj77" Jul 24 03:19:03.353447 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.353442 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b3df521-c842-467d-a7b6-d9c089ff6119-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fn82q\" (UID: \"7b3df521-c842-467d-a7b6-d9c089ff6119\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:19:03.444708 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.444679 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jdldz\"" Jul 24 03:19:03.452871 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.452829 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" Jul 24 03:19:03.473235 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.473199 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-frvz7\"" Jul 24 03:19:03.481383 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.481349 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:19:03.503552 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.503484 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vm6xj\"" Jul 24 03:19:03.509781 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.509762 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-97jhl\"" Jul 24 03:19:03.511724 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.511709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:03.517966 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.517945 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" Jul 24 03:19:03.532664 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.532645 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gd8s9\"" Jul 24 03:19:03.540842 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.540818 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6jj77" Jul 24 03:19:03.543121 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.543100 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hbzxx\"" Jul 24 03:19:03.551485 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.551451 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" Jul 24 03:19:03.773611 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.773559 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b25hj"] Jul 24 03:19:03.835855 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:03.835796 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ktlcb"] Jul 24 03:19:03.893058 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:03.893002 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22cf01fa_32a1_49b0_9722_d3fbd4fcb738.slice/crio-2701650eb8afc03e86b78816a79480c2fb58b32446578e3bc947dc17ff0ee838 WatchSource:0}: Error finding container 2701650eb8afc03e86b78816a79480c2fb58b32446578e3bc947dc17ff0ee838: Status 404 returned error can't find the container with id 2701650eb8afc03e86b78816a79480c2fb58b32446578e3bc947dc17ff0ee838 Jul 24 03:19:03.893551 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:03.893507 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58390921_c114_4dd6_a334_c3ecadf82534.slice/crio-bca8cf2b242944337f97f39309f55ebe07f3dcd84b319dbbd13da432076f10d2 WatchSource:0}: Error finding container bca8cf2b242944337f97f39309f55ebe07f3dcd84b319dbbd13da432076f10d2: Status 404 returned error can't find the container with id bca8cf2b242944337f97f39309f55ebe07f3dcd84b319dbbd13da432076f10d2 Jul 24 03:19:04.066632 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.066591 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qtwg5"] Jul 24 03:19:04.071462 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:04.071436 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod434d1dd7_7bea_4781_b385_eeed01587e4a.slice/crio-8a8457e9f5c357ed3477f867292a4a93ca9c7290ad20d347f1ed3bf5fc8edf3b WatchSource:0}: Error finding container 8a8457e9f5c357ed3477f867292a4a93ca9c7290ad20d347f1ed3bf5fc8edf3b: Status 404 returned error can't find the container with id 8a8457e9f5c357ed3477f867292a4a93ca9c7290ad20d347f1ed3bf5fc8edf3b Jul 24 03:19:04.075953 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.075928 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d7f4d4684-cz5n2"] Jul 24 03:19:04.078022 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:04.078000 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec17a6d_115b_4ebb_ac14_ca396902c126.slice/crio-c99472860ab766514221f795fe372ad7689a3ca811b949edd14dca1a82a790c5 WatchSource:0}: Error finding container c99472860ab766514221f795fe372ad7689a3ca811b949edd14dca1a82a790c5: Status 404 returned error can't find the container with id c99472860ab766514221f795fe372ad7689a3ca811b949edd14dca1a82a790c5 Jul 24 03:19:04.083710 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.083689 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb"] Jul 24 03:19:04.087750 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.087722 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs"] Jul 24 03:19:04.089626 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.089605 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67f88b97c-dvxwx"] Jul 24 03:19:04.091179 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:04.091150 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746d05c8_e84f_4fab_92a7_4dd04f4878f6.slice/crio-7f1a886f7ec5e6de1de767b35dbc940e0bfb9a5fe34651020f673c1de628f40b WatchSource:0}: Error finding container 7f1a886f7ec5e6de1de767b35dbc940e0bfb9a5fe34651020f673c1de628f40b: Status 404 returned error can't find the container with id 7f1a886f7ec5e6de1de767b35dbc940e0bfb9a5fe34651020f673c1de628f40b Jul 24 03:19:04.091951 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:04.091930 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb09d7be_7af6_49c0_bc46_5c27691156ce.slice/crio-1eac4189557b1d8e903de695e86b212888c0f0e95c2b63e197ec94eae0645c74 WatchSource:0}: Error finding container 1eac4189557b1d8e903de695e86b212888c0f0e95c2b63e197ec94eae0645c74: Status 404 returned error can't find the container with id 1eac4189557b1d8e903de695e86b212888c0f0e95c2b63e197ec94eae0645c74 Jul 24 03:19:04.127860 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.127831 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fn82q"] Jul 24 03:19:04.130955 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.130931 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6jj77"] Jul 24 03:19:04.139593 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:04.139549 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b3df521_c842_467d_a7b6_d9c089ff6119.slice/crio-35ce3993c54e89bedbc22e92ae40bb95a154f74950ced7574e54be418f43d073 WatchSource:0}: Error finding container 35ce3993c54e89bedbc22e92ae40bb95a154f74950ced7574e54be418f43d073: Status 404 returned error can't find the container with id 35ce3993c54e89bedbc22e92ae40bb95a154f74950ced7574e54be418f43d073 Jul 24 03:19:04.139937 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:04.139915 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68348238_a827_4623_a962_75d06e9c76e3.slice/crio-869ed55d50df62e28c56025003d487857b442ccd728962d61ece5f286afd92d9 WatchSource:0}: Error finding container 869ed55d50df62e28c56025003d487857b442ccd728962d61ece5f286afd92d9: Status 404 returned error can't find the container with id 869ed55d50df62e28c56025003d487857b442ccd728962d61ece5f286afd92d9 Jul 24 03:19:04.345688 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.345595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" event={"ID":"7b3df521-c842-467d-a7b6-d9c089ff6119","Type":"ContainerStarted","Data":"35ce3993c54e89bedbc22e92ae40bb95a154f74950ced7574e54be418f43d073"} Jul 24 03:19:04.347189 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.347155 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" event={"ID":"746d05c8-e84f-4fab-92a7-4dd04f4878f6","Type":"ContainerStarted","Data":"7f1a886f7ec5e6de1de767b35dbc940e0bfb9a5fe34651020f673c1de628f40b"} Jul 24 03:19:04.349329 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.349302 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ktlcb" event={"ID":"58390921-c114-4dd6-a334-c3ecadf82534","Type":"ContainerStarted","Data":"5d5d80ae12243c3f590ade20ca94b8b307a37008d6916392ff684bdf312c8f01"} Jul 24 03:19:04.349454 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.349346 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ktlcb" event={"ID":"58390921-c114-4dd6-a334-c3ecadf82534","Type":"ContainerStarted","Data":"bca8cf2b242944337f97f39309f55ebe07f3dcd84b319dbbd13da432076f10d2"} Jul 24 03:19:04.349454 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.349387 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:19:04.351664 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.351638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" event={"ID":"b02517af-8728-4ca9-b3de-1f7785e30ec9","Type":"ContainerStarted","Data":"63b36e0dfb9c9e731041a0e6da3a9c39f14a33d1014fa151e3f6147a7127975e"} Jul 24 03:19:04.352898 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.352874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jj77" event={"ID":"68348238-a827-4623-a962-75d06e9c76e3","Type":"ContainerStarted","Data":"869ed55d50df62e28c56025003d487857b442ccd728962d61ece5f286afd92d9"} Jul 24 03:19:04.354216 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.354192 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtwg5" event={"ID":"434d1dd7-7bea-4781-b385-eeed01587e4a","Type":"ContainerStarted","Data":"8a8457e9f5c357ed3477f867292a4a93ca9c7290ad20d347f1ed3bf5fc8edf3b"} Jul 24 03:19:04.355866 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.355845 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr826" event={"ID":"d7c8f9d5-ef5f-438e-87cc-72d0a6926423","Type":"ContainerStarted","Data":"e5e13ca581496f258573498ac37eef50c4244295a06da7378fa637901ff5cf66"} Jul 24 03:19:04.358112 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.358089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" event={"ID":"7ec17a6d-115b-4ebb-ac14-ca396902c126","Type":"ContainerStarted","Data":"506889da3bb809362d27ca227eb267419fe96a280bcb1b1a7d8fecef90400096"} Jul 24 03:19:04.358199 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.358131 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" event={"ID":"7ec17a6d-115b-4ebb-ac14-ca396902c126","Type":"ContainerStarted","Data":"c99472860ab766514221f795fe372ad7689a3ca811b949edd14dca1a82a790c5"} Jul 24 03:19:04.358303 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.358266 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:19:04.359917 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.359890 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67f88b97c-dvxwx" event={"ID":"cb09d7be-7af6-49c0-bc46-5c27691156ce","Type":"ContainerStarted","Data":"a51646a343391d8b0505ae02e7e3182110cdea8924b5b5c42e8a53da83e6d24d"} Jul 24 03:19:04.360017 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.359939 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67f88b97c-dvxwx" event={"ID":"cb09d7be-7af6-49c0-bc46-5c27691156ce","Type":"ContainerStarted","Data":"1eac4189557b1d8e903de695e86b212888c0f0e95c2b63e197ec94eae0645c74"} Jul 24 03:19:04.361271 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.361226 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b25hj" event={"ID":"22cf01fa-32a1-49b0-9722-d3fbd4fcb738","Type":"ContainerStarted","Data":"2701650eb8afc03e86b78816a79480c2fb58b32446578e3bc947dc17ff0ee838"} Jul 24 03:19:04.382177 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.382113 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ktlcb" podStartSLOduration=68.382092812 podStartE2EDuration="1m8.382092812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:04.381468561 +0000 UTC m=+67.956118493" watchObservedRunningTime="2026-07-24 03:19:04.382092812 +0000 UTC m=+67.956742744" Jul 24 03:19:04.412929 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.412875 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" podStartSLOduration=67.412858511 podStartE2EDuration="1m7.412858511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:04.411941079 +0000 UTC m=+67.986591042" watchObservedRunningTime="2026-07-24 03:19:04.412858511 +0000 UTC m=+67.987508444" Jul 24 03:19:04.434190 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.433420 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67f88b97c-dvxwx" podStartSLOduration=67.433397773 podStartE2EDuration="1m7.433397773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:04.431788563 +0000 UTC m=+68.006438507" watchObservedRunningTime="2026-07-24 03:19:04.433397773 +0000 UTC m=+68.008047705" Jul 24 03:19:04.512996 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.512916 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:04.515962 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:04.515939 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:05.369318 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:05.369100 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:05.370489 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:05.370465 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67f88b97c-dvxwx" Jul 24 03:19:05.899546 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:05.899511 2559 scope.go:117] "RemoveContainer" containerID="74a7bf8158c472521b728eb2749ca1a2990edc00260e4e89476105bd7260a5b8" Jul 24 03:19:12.403128 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.403099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:19:12.403617 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.403209 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" event={"ID":"538669b7-54b4-4f39-b542-932532b0aede","Type":"ContainerStarted","Data":"ad2fb3859d727fe33485e96f063013e13fb3866ad6dc7bdb905e6e44540ffc52"} Jul 24 03:19:12.403794 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.403776 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:19:12.405543 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.405503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" event={"ID":"b02517af-8728-4ca9-b3de-1f7785e30ec9","Type":"ContainerStarted","Data":"4887a9e0c842c1f0f3fe7f02cdf52f199f3456978ad8c4b3679b88d56b1556aa"} Jul 24 03:19:12.405675 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.405553 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" event={"ID":"b02517af-8728-4ca9-b3de-1f7785e30ec9","Type":"ContainerStarted","Data":"3671335dffe63656d0376925b6c056a345179f43804e7b8f152e8c9697519554"} Jul 24 03:19:12.407918 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.407895 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jj77" event={"ID":"68348238-a827-4623-a962-75d06e9c76e3","Type":"ContainerStarted","Data":"420b490043de6dd64cb658aef4ed7f1534ba15447262cd4567b2f009f690e7c7"} Jul 24 03:19:12.408007 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.407937 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6jj77" event={"ID":"68348238-a827-4623-a962-75d06e9c76e3","Type":"ContainerStarted","Data":"ecef2600adba0a812934d7693cb29ab55190791452b825e63cc5757be00f6222"} Jul 24 03:19:12.408456 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.408410 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6jj77" Jul 24 03:19:12.410092 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.410026 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtwg5" event={"ID":"434d1dd7-7bea-4781-b385-eeed01587e4a","Type":"ContainerStarted","Data":"be3277c36c8f23803c24871d1ba6816db76ee6202bfec44a135c4478cd4c3711"} Jul 24 03:19:12.410092 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.410063 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtwg5" event={"ID":"434d1dd7-7bea-4781-b385-eeed01587e4a","Type":"ContainerStarted","Data":"36332ec8fbe4e3c8e5d599b9f7447aafacdf551fe3385f6a401f1ef2636b38b6"} Jul 24 03:19:12.411883 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.411832 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr826" event={"ID":"d7c8f9d5-ef5f-438e-87cc-72d0a6926423","Type":"ContainerStarted","Data":"68b71b77b8202c86760c4e0895fb53b5cf8cb6e02a674c7c387dbf379f7e2939"} Jul 24 03:19:12.413171 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.413133 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b25hj" event={"ID":"22cf01fa-32a1-49b0-9722-d3fbd4fcb738","Type":"ContainerStarted","Data":"60cbbc2aa405eed966f28917fc48000da04f2142d71353a88f6c245a547a4a64"} Jul 24 03:19:12.414946 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.414573 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" event={"ID":"7b3df521-c842-467d-a7b6-d9c089ff6119","Type":"ContainerStarted","Data":"fcc31d518c53c42e9e519ec3708ae3fd322a636e2183c6eff3a89b8bccfe8fa7"} Jul 24 03:19:12.416244 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.416184 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" event={"ID":"746d05c8-e84f-4fab-92a7-4dd04f4878f6","Type":"ContainerStarted","Data":"07cf4a8e88adaf75529190882f25fabf65ffb8441e7d54df7fa710666482afad"} Jul 24 03:19:12.424770 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.423668 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" podStartSLOduration=66.046866592 podStartE2EDuration="1m15.42364908s" totalImagesPullingTime="9.376782488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:12.422479573 +0000 UTC m=+75.997129505" watchObservedRunningTime="2026-07-24 03:19:12.42364908 +0000 UTC m=+75.998299013" Jul 24 03:19:12.445055 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.444947 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wfrvb" podStartSLOduration=67.768388778 podStartE2EDuration="1m15.444925709s" totalImagesPullingTime="7.676536931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:12.444067742 +0000 UTC m=+76.018717674" watchObservedRunningTime="2026-07-24 03:19:12.444925709 +0000 UTC m=+76.019575643" Jul 24 03:19:12.463220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.463165 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b25hj" podStartSLOduration=67.544144995 podStartE2EDuration="1m15.463144696s" totalImagesPullingTime="7.918999701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:12.462079974 +0000 UTC m=+76.036729906" watchObservedRunningTime="2026-07-24 03:19:12.463144696 +0000 UTC m=+76.037794630" Jul 24 03:19:12.479664 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.479598 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qtwg5" podStartSLOduration=68.679781499 podStartE2EDuration="1m15.479583102s" totalImagesPullingTime="6.799801603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:12.478117722 +0000 UTC m=+76.052767654" watchObservedRunningTime="2026-07-24 03:19:12.479583102 +0000 UTC m=+76.054233034" Jul 24 03:19:12.497142 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.497082 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fn82q" podStartSLOduration=38.767730322 podStartE2EDuration="45.497061791s" totalImagesPullingTime="6.729331469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:12.496151724 +0000 UTC m=+76.070801677" watchObservedRunningTime="2026-07-24 03:19:12.497061791 +0000 UTC m=+76.071711723" Jul 24 03:19:12.521354 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.521299 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6jj77" podStartSLOduration=33.838224218 podStartE2EDuration="41.521259157s" totalImagesPullingTime="7.683034939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:12.518904289 +0000 UTC m=+76.093554221" watchObservedRunningTime="2026-07-24 03:19:12.521259157 +0000 UTC m=+76.095909091" Jul 24 03:19:12.539538 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.539483 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-lknbs" podStartSLOduration=67.805743807 podStartE2EDuration="1m15.539461014s" totalImagesPullingTime="7.733717207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:12.538840702 +0000 UTC m=+76.113490635" watchObservedRunningTime="2026-07-24 03:19:12.539461014 +0000 UTC m=+76.114110947" Jul 24 03:19:12.648137 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:12.648104 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-rs8hf" Jul 24 03:19:17.440903 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:17.440871 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xr826" event={"ID":"d7c8f9d5-ef5f-438e-87cc-72d0a6926423","Type":"ContainerStarted","Data":"691b4354a3f6406b18022d5a35eef8397039352b0e494f5f02d413320dadc472"} Jul 24 03:19:17.462404 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:17.462345 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xr826" podStartSLOduration=17.924864198 podStartE2EDuration="35.462329586s" totalImagesPullingTime="17.537465388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:18:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:17.461758211 +0000 UTC m=+81.036408143" watchObservedRunningTime="2026-07-24 03:19:17.462329586 +0000 UTC m=+81.036979536" Jul 24 03:19:23.428083 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:23.427951 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6jj77" Jul 24 03:19:23.485871 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:23.485833 2559 patch_prober.go:28] interesting pod/image-registry-5d7f4d4684-cz5n2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 24 03:19:23.486040 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:23.485890 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" podUID="7ec17a6d-115b-4ebb-ac14-ca396902c126" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 03:19:24.018148 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.018107 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5rrs7"] Jul 24 03:19:24.021378 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.021348 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.024207 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.024175 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 03:19:24.024434 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.024388 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 03:19:24.024504 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.024450 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rs2nn\"" Jul 24 03:19:24.024561 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.024515 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 03:19:24.024700 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.024684 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 03:19:24.039468 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wckj\" (UniqueName: \"kubernetes.io/projected/588f275f-2849-4276-bb1a-be7a6097e857-kube-api-access-6wckj\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.039468 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039480 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-accelerators-collector-config\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.039777 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-textfile\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.039777 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.039777 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039553 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/588f275f-2849-4276-bb1a-be7a6097e857-metrics-client-ca\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.039777 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-tls\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.039777 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-root\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.039777 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039677 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-wtmp\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.039777 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.039705 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-sys\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141035 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.140985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-wtmp\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141232 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-sys\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141232 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wckj\" (UniqueName: \"kubernetes.io/projected/588f275f-2849-4276-bb1a-be7a6097e857-kube-api-access-6wckj\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141232 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-accelerators-collector-config\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141232 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-textfile\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141232 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141232 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141196 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-wtmp\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141232 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/588f275f-2849-4276-bb1a-be7a6097e857-metrics-client-ca\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141599 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-tls\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141599 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141350 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-root\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141599 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141454 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-root\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141599 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141516 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/588f275f-2849-4276-bb1a-be7a6097e857-sys\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.141599 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:19:24.141546 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 24 03:19:24.141843 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:19:24.141615 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-tls podName:588f275f-2849-4276-bb1a-be7a6097e857 nodeName:}" failed. No retries permitted until 2026-07-24 03:19:24.641594621 +0000 UTC m=+88.216244535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-tls") pod "node-exporter-5rrs7" (UID: "588f275f-2849-4276-bb1a-be7a6097e857") : secret "node-exporter-tls" not found Jul 24 03:19:24.141905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.141842 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-accelerators-collector-config\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.142295 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.142247 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/588f275f-2849-4276-bb1a-be7a6097e857-metrics-client-ca\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.142463 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.142435 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-textfile\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.145268 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.145239 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.151075 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.151036 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wckj\" (UniqueName: \"kubernetes.io/projected/588f275f-2849-4276-bb1a-be7a6097e857-kube-api-access-6wckj\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.644822 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.644779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-tls\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.647472 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.647444 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/588f275f-2849-4276-bb1a-be7a6097e857-node-exporter-tls\") pod \"node-exporter-5rrs7\" (UID: \"588f275f-2849-4276-bb1a-be7a6097e857\") " pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.935044 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:24.934956 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5rrs7" Jul 24 03:19:24.948868 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:19:24.948830 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588f275f_2849_4276_bb1a_be7a6097e857.slice/crio-29f2401cfbf261dc3ee53fd78589b6899615e0ff2eed56d6b36586e90d76e842 WatchSource:0}: Error finding container 29f2401cfbf261dc3ee53fd78589b6899615e0ff2eed56d6b36586e90d76e842: Status 404 returned error can't find the container with id 29f2401cfbf261dc3ee53fd78589b6899615e0ff2eed56d6b36586e90d76e842 Jul 24 03:19:25.375530 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:25.375498 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:19:25.474440 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:25.474386 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5rrs7" event={"ID":"588f275f-2849-4276-bb1a-be7a6097e857","Type":"ContainerStarted","Data":"29f2401cfbf261dc3ee53fd78589b6899615e0ff2eed56d6b36586e90d76e842"} Jul 24 03:19:26.479297 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:26.479249 2559 generic.go:356] "Generic (PLEG): container finished" podID="588f275f-2849-4276-bb1a-be7a6097e857" containerID="9f883dddcf24d8bd1a8f849a8244cdf6827ecff58af6b31a30797b98e263c54d" exitCode=0 Jul 24 03:19:26.479705 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:26.479339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5rrs7" event={"ID":"588f275f-2849-4276-bb1a-be7a6097e857","Type":"ContainerDied","Data":"9f883dddcf24d8bd1a8f849a8244cdf6827ecff58af6b31a30797b98e263c54d"} Jul 24 03:19:27.485631 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:27.485592 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5rrs7" event={"ID":"588f275f-2849-4276-bb1a-be7a6097e857","Type":"ContainerStarted","Data":"811caef10ec0705c3ab7e58a098a55a39680475d12d128c986a5d3e9fc03a5d5"} Jul 24 03:19:27.486109 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:27.485654 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5rrs7" event={"ID":"588f275f-2849-4276-bb1a-be7a6097e857","Type":"ContainerStarted","Data":"7fb9e6c23d32a0b02cb4c40ebde96ae21199f58c9b938fd753a92d5f0cb7bc9f"} Jul 24 03:19:27.507499 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:27.507444 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5rrs7" podStartSLOduration=3.621571828 podStartE2EDuration="4.507427737s" totalImagesPullingTime="806.438349ms" totalInitContainerRuntime="79.41756ms" isStatefulPod=true podCreationTimestamp="2026-07-24 03:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:19:27.505795985 +0000 UTC m=+91.080445937" watchObservedRunningTime="2026-07-24 03:19:27.507427737 +0000 UTC m=+91.082077669" Jul 24 03:19:29.374148 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:29.374114 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d7f4d4684-cz5n2"] Jul 24 03:19:35.371977 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:35.371945 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ktlcb" Jul 24 03:19:52.582941 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:52.582909 2559 generic.go:356] "Generic (PLEG): container finished" podID="fec1aca6-81f3-4b05-89be-89d80de7a406" containerID="2def37a2283a2f80d47c9c635b7fd8e99e41f41f8735e0ae388cdca5ad9dec07" exitCode=0 Jul 24 03:19:52.583388 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:52.582992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" event={"ID":"fec1aca6-81f3-4b05-89be-89d80de7a406","Type":"ContainerDied","Data":"2def37a2283a2f80d47c9c635b7fd8e99e41f41f8735e0ae388cdca5ad9dec07"} Jul 24 03:19:52.583388 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:52.583316 2559 scope.go:117] "RemoveContainer" containerID="2def37a2283a2f80d47c9c635b7fd8e99e41f41f8735e0ae388cdca5ad9dec07" Jul 24 03:19:53.588377 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:53.588345 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-9vrv8" event={"ID":"fec1aca6-81f3-4b05-89be-89d80de7a406","Type":"ContainerStarted","Data":"a24f33dc0be7b361faea52ca3efd3d78cfb614b52e1fff84aeb33b153c09164e"} Jul 24 03:19:53.589703 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:53.589678 2559 generic.go:356] "Generic (PLEG): container finished" podID="e1f10169-faf5-4ac3-a695-85d4a238de8f" containerID="388c0af5fa51c1370d90b7471b7c8032e7567d1887e7cb18f83311c7bd42db6e" exitCode=0 Jul 24 03:19:53.589836 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:53.589729 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" event={"ID":"e1f10169-faf5-4ac3-a695-85d4a238de8f","Type":"ContainerDied","Data":"388c0af5fa51c1370d90b7471b7c8032e7567d1887e7cb18f83311c7bd42db6e"} Jul 24 03:19:53.590031 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:53.590014 2559 scope.go:117] "RemoveContainer" containerID="388c0af5fa51c1370d90b7471b7c8032e7567d1887e7cb18f83311c7bd42db6e" Jul 24 03:19:54.394176 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.394134 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" podUID="7ec17a6d-115b-4ebb-ac14-ca396902c126" containerName="registry" containerID="cri-o://506889da3bb809362d27ca227eb267419fe96a280bcb1b1a7d8fecef90400096" gracePeriod=30 Jul 24 03:19:54.595991 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.595952 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj" event={"ID":"e1f10169-faf5-4ac3-a695-85d4a238de8f","Type":"ContainerStarted","Data":"de9f6fac3f58d7834564d94201225bc33e26cd945cb69e6c542099a740342510"} Jul 24 03:19:54.597639 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.597614 2559 generic.go:356] "Generic (PLEG): container finished" podID="7ec17a6d-115b-4ebb-ac14-ca396902c126" containerID="506889da3bb809362d27ca227eb267419fe96a280bcb1b1a7d8fecef90400096" exitCode=0 Jul 24 03:19:54.597757 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.597681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" event={"ID":"7ec17a6d-115b-4ebb-ac14-ca396902c126","Type":"ContainerDied","Data":"506889da3bb809362d27ca227eb267419fe96a280bcb1b1a7d8fecef90400096"} Jul 24 03:19:54.640370 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.640340 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:19:54.792518 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.792475 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-image-registry-private-configuration\") pod \"7ec17a6d-115b-4ebb-ac14-ca396902c126\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " Jul 24 03:19:54.792518 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.792528 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-bound-sa-token\") pod \"7ec17a6d-115b-4ebb-ac14-ca396902c126\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " Jul 24 03:19:54.792776 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.792563 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-certificates\") pod \"7ec17a6d-115b-4ebb-ac14-ca396902c126\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " Jul 24 03:19:54.792776 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.792583 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-trusted-ca\") pod \"7ec17a6d-115b-4ebb-ac14-ca396902c126\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " Jul 24 03:19:54.792776 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.792599 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") pod \"7ec17a6d-115b-4ebb-ac14-ca396902c126\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " Jul 24 03:19:54.792776 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.792616 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-installation-pull-secrets\") pod \"7ec17a6d-115b-4ebb-ac14-ca396902c126\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " Jul 24 03:19:54.792776 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.792664 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttqlt\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-kube-api-access-ttqlt\") pod \"7ec17a6d-115b-4ebb-ac14-ca396902c126\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " Jul 24 03:19:54.792776 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.792684 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ec17a6d-115b-4ebb-ac14-ca396902c126-ca-trust-extracted\") pod \"7ec17a6d-115b-4ebb-ac14-ca396902c126\" (UID: \"7ec17a6d-115b-4ebb-ac14-ca396902c126\") " Jul 24 03:19:54.793128 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.793091 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7ec17a6d-115b-4ebb-ac14-ca396902c126" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:19:54.793209 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.793116 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7ec17a6d-115b-4ebb-ac14-ca396902c126" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:19:54.795268 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.795244 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7ec17a6d-115b-4ebb-ac14-ca396902c126" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:19:54.795406 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.795371 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-kube-api-access-ttqlt" (OuterVolumeSpecName: "kube-api-access-ttqlt") pod "7ec17a6d-115b-4ebb-ac14-ca396902c126" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126"). InnerVolumeSpecName "kube-api-access-ttqlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:19:54.795472 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.795447 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7ec17a6d-115b-4ebb-ac14-ca396902c126" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:19:54.795628 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.795607 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7ec17a6d-115b-4ebb-ac14-ca396902c126" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:19:54.796002 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.795977 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7ec17a6d-115b-4ebb-ac14-ca396902c126" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:19:54.801615 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.801591 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec17a6d-115b-4ebb-ac14-ca396902c126-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7ec17a6d-115b-4ebb-ac14-ca396902c126" (UID: "7ec17a6d-115b-4ebb-ac14-ca396902c126"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:19:54.893475 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.893427 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-image-registry-private-configuration\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:19:54.893475 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.893473 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-bound-sa-token\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:19:54.893475 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.893486 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-certificates\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:19:54.893690 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.893495 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ec17a6d-115b-4ebb-ac14-ca396902c126-trusted-ca\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:19:54.893690 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.893505 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-registry-tls\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:19:54.893690 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.893513 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ec17a6d-115b-4ebb-ac14-ca396902c126-installation-pull-secrets\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:19:54.893690 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.893521 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttqlt\" (UniqueName: \"kubernetes.io/projected/7ec17a6d-115b-4ebb-ac14-ca396902c126-kube-api-access-ttqlt\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:19:54.893690 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:54.893530 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ec17a6d-115b-4ebb-ac14-ca396902c126-ca-trust-extracted\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:19:55.603074 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:55.603041 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" Jul 24 03:19:55.603074 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:55.603069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d7f4d4684-cz5n2" event={"ID":"7ec17a6d-115b-4ebb-ac14-ca396902c126","Type":"ContainerDied","Data":"c99472860ab766514221f795fe372ad7689a3ca811b949edd14dca1a82a790c5"} Jul 24 03:19:55.603634 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:55.603129 2559 scope.go:117] "RemoveContainer" containerID="506889da3bb809362d27ca227eb267419fe96a280bcb1b1a7d8fecef90400096" Jul 24 03:19:55.620324 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:55.620296 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d7f4d4684-cz5n2"] Jul 24 03:19:55.623571 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:55.623549 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d7f4d4684-cz5n2"] Jul 24 03:19:56.908921 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:56.908890 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ec17a6d-115b-4ebb-ac14-ca396902c126" path="/var/lib/kubelet/pods/7ec17a6d-115b-4ebb-ac14-ca396902c126/volumes" Jul 24 03:19:57.613059 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:57.613026 2559 generic.go:356] "Generic (PLEG): container finished" podID="6169a7c8-6149-41c8-8b99-61f49d40a0d5" containerID="87a1c963a1f85b91104299c325f7347899dfa759ab7704d0c8890913a40fd5ca" exitCode=0 Jul 24 03:19:57.613255 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:57.613079 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-5p6ql" event={"ID":"6169a7c8-6149-41c8-8b99-61f49d40a0d5","Type":"ContainerDied","Data":"87a1c963a1f85b91104299c325f7347899dfa759ab7704d0c8890913a40fd5ca"} Jul 24 03:19:57.613481 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:57.613466 2559 scope.go:117] "RemoveContainer" containerID="87a1c963a1f85b91104299c325f7347899dfa759ab7704d0c8890913a40fd5ca" Jul 24 03:19:58.619064 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:19:58.619029 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-5p6ql" event={"ID":"6169a7c8-6149-41c8-8b99-61f49d40a0d5","Type":"ContainerStarted","Data":"5e1f0f829d52535dff63c4a47e95374a4438cc24f902a3838ce985c16802cb1c"} Jul 24 03:22:32.791668 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.791586 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz"] Jul 24 03:22:32.792105 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.791863 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec17a6d-115b-4ebb-ac14-ca396902c126" containerName="registry" Jul 24 03:22:32.792105 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.791873 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec17a6d-115b-4ebb-ac14-ca396902c126" containerName="registry" Jul 24 03:22:32.792105 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.791920 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ec17a6d-115b-4ebb-ac14-ca396902c126" containerName="registry" Jul 24 03:22:32.794899 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.794882 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:32.797505 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.797481 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 24 03:22:32.798536 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.798514 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 03:22:32.798666 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.798601 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 24 03:22:32.798733 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.798564 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 24 03:22:32.798733 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.798566 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 03:22:32.798733 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.798584 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 03:22:32.798865 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.798568 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 24 03:22:32.807891 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.807870 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz"] Jul 24 03:22:32.899985 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.899949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1247627-de3b-41d4-be75-a8f27a5e3d6f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:32.899985 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.899988 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gbg8\" (UniqueName: \"kubernetes.io/projected/c1247627-de3b-41d4-be75-a8f27a5e3d6f-kube-api-access-7gbg8\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:32.900233 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.900008 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-ca\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:32.900233 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.900026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-hub\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:32.900233 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.900082 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:32.900233 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:32.900137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.000937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.000893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1247627-de3b-41d4-be75-a8f27a5e3d6f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.000937 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.000939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gbg8\" (UniqueName: \"kubernetes.io/projected/c1247627-de3b-41d4-be75-a8f27a5e3d6f-kube-api-access-7gbg8\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.001189 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.001072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-ca\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.001189 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.001118 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-hub\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.001189 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.001149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.001379 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.001189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.001691 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.001657 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1247627-de3b-41d4-be75-a8f27a5e3d6f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.003653 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.003622 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-ca\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.003835 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.003816 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.003952 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.003928 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-hub\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.004015 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.003975 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1247627-de3b-41d4-be75-a8f27a5e3d6f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.014612 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.014584 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gbg8\" (UniqueName: \"kubernetes.io/projected/c1247627-de3b-41d4-be75-a8f27a5e3d6f-kube-api-access-7gbg8\") pod \"cluster-proxy-proxy-agent-855cdb5f4f-5cwqz\" (UID: \"c1247627-de3b-41d4-be75-a8f27a5e3d6f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.118244 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.118154 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" Jul 24 03:22:33.253249 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:33.253227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz"] Jul 24 03:22:33.255429 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:22:33.255405 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1247627_de3b_41d4_be75_a8f27a5e3d6f.slice/crio-d15b4903bdea50b426b46fc31b77473924451811cdb222dd659db7b8c6b72fca WatchSource:0}: Error finding container d15b4903bdea50b426b46fc31b77473924451811cdb222dd659db7b8c6b72fca: Status 404 returned error can't find the container with id d15b4903bdea50b426b46fc31b77473924451811cdb222dd659db7b8c6b72fca Jul 24 03:22:34.192043 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:34.192001 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" event={"ID":"c1247627-de3b-41d4-be75-a8f27a5e3d6f","Type":"ContainerStarted","Data":"d15b4903bdea50b426b46fc31b77473924451811cdb222dd659db7b8c6b72fca"} Jul 24 03:22:37.206740 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:37.206701 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" event={"ID":"c1247627-de3b-41d4-be75-a8f27a5e3d6f","Type":"ContainerStarted","Data":"0598b83a0df0af4b34af3a33042b892a2402042d461c08b9b69c5ed05aed7716"} Jul 24 03:22:37.207128 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:37.206756 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" event={"ID":"c1247627-de3b-41d4-be75-a8f27a5e3d6f","Type":"ContainerStarted","Data":"31ecdb36e6733f6839d8b111a753847e94afd5795851ca08e649be1c6f1e81db"} Jul 24 03:22:37.207128 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:37.206773 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" event={"ID":"c1247627-de3b-41d4-be75-a8f27a5e3d6f","Type":"ContainerStarted","Data":"1fe673e3e0c06e50baa3f784ead9586ab7f5af856ee8cb8bb465f47ca2a57d35"} Jul 24 03:22:37.223703 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:37.223659 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-855cdb5f4f-5cwqz" podStartSLOduration=1.7573381609999998 podStartE2EDuration="5.223643477s" totalImagesPullingTime="3.466305316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:22:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:22:37.222463103 +0000 UTC m=+280.797113037" watchObservedRunningTime="2026-07-24 03:22:37.223643477 +0000 UTC m=+280.798293411" Jul 24 03:22:56.744978 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:56.744950 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:22:56.747213 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:56.747192 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:22:56.753846 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:56.753826 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:22:56.756394 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:56.756372 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:22:56.757468 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:22:56.757453 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 03:24:11.345541 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.345466 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq"] Jul 24 03:24:11.347587 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.347572 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.352807 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.352780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 03:24:11.352971 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.352892 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 03:24:11.353037 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.353007 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 03:24:11.353133 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.353116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 03:24:11.354109 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.354031 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l74m9\"" Jul 24 03:24:11.379125 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.379086 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq"] Jul 24 03:24:11.458075 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.458043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c003ac4-352e-46ac-872a-5dcdf32ecd46-tmp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.458243 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.458092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c003ac4-352e-46ac-872a-5dcdf32ecd46-manifests\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.458243 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.458156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69lf4\" (UniqueName: \"kubernetes.io/projected/4c003ac4-352e-46ac-872a-5dcdf32ecd46-kube-api-access-69lf4\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.458243 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.458185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c003ac4-352e-46ac-872a-5dcdf32ecd46-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.458243 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.458204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c003ac4-352e-46ac-872a-5dcdf32ecd46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.559547 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.559508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69lf4\" (UniqueName: \"kubernetes.io/projected/4c003ac4-352e-46ac-872a-5dcdf32ecd46-kube-api-access-69lf4\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.559751 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.559555 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c003ac4-352e-46ac-872a-5dcdf32ecd46-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.559751 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.559682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c003ac4-352e-46ac-872a-5dcdf32ecd46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.559874 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.559801 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c003ac4-352e-46ac-872a-5dcdf32ecd46-tmp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.559874 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.559856 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c003ac4-352e-46ac-872a-5dcdf32ecd46-manifests\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.560264 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.560234 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c003ac4-352e-46ac-872a-5dcdf32ecd46-manifests\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.562163 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.562142 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c003ac4-352e-46ac-872a-5dcdf32ecd46-tmp\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.562588 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.562567 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c003ac4-352e-46ac-872a-5dcdf32ecd46-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.562670 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.562567 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c003ac4-352e-46ac-872a-5dcdf32ecd46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.578395 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.578372 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69lf4\" (UniqueName: \"kubernetes.io/projected/4c003ac4-352e-46ac-872a-5dcdf32ecd46-kube-api-access-69lf4\") pod \"opendatahub-operator-controller-manager-5c75c644cf-p6hbq\" (UID: \"4c003ac4-352e-46ac-872a-5dcdf32ecd46\") " pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.657295 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.657181 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:11.830758 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.830719 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq"] Jul 24 03:24:11.841732 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:11.841706 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 03:24:12.573593 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:12.573526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" event={"ID":"4c003ac4-352e-46ac-872a-5dcdf32ecd46","Type":"ContainerStarted","Data":"7dc2f7d0d28cba45e6560a1cbe8064e1640889ff626069f2343f577ef87bdd49"} Jul 24 03:24:15.589523 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:15.589490 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" event={"ID":"4c003ac4-352e-46ac-872a-5dcdf32ecd46","Type":"ContainerStarted","Data":"81e823fa6cdb2f03212f8065c8d90891d01fcfc2af07218c49a8713fd8c5f3f8"} Jul 24 03:24:16.595626 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:16.595591 2559 generic.go:356] "Generic (PLEG): container finished" podID="4c003ac4-352e-46ac-872a-5dcdf32ecd46" containerID="81e823fa6cdb2f03212f8065c8d90891d01fcfc2af07218c49a8713fd8c5f3f8" exitCode=0 Jul 24 03:24:16.596009 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:16.595631 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" event={"ID":"4c003ac4-352e-46ac-872a-5dcdf32ecd46","Type":"ContainerDied","Data":"81e823fa6cdb2f03212f8065c8d90891d01fcfc2af07218c49a8713fd8c5f3f8"} Jul 24 03:24:17.601328 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:17.601269 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" event={"ID":"4c003ac4-352e-46ac-872a-5dcdf32ecd46","Type":"ContainerStarted","Data":"d2bbdbdd5ce0392e45570ea49104c23a1cb37ae99dbaf6aaaef536c88d2accf0"} Jul 24 03:24:17.601762 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:17.601426 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:17.623846 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:17.623793 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" podStartSLOduration=2.304163447 podStartE2EDuration="6.623773194s" totalImagesPullingTime="3.275899826s" totalInitContainerRuntime="1.043709921s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:17.622332727 +0000 UTC m=+381.196982681" watchObservedRunningTime="2026-07-24 03:24:17.623773194 +0000 UTC m=+381.198423131" Jul 24 03:24:28.608850 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:28.608814 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c75c644cf-p6hbq" Jul 24 03:24:31.582313 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.582263 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw"] Jul 24 03:24:31.591832 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.591807 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.594906 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.594878 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 03:24:31.595465 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.595449 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 03:24:31.617981 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.617949 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw"] Jul 24 03:24:31.731654 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.731615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce67ee07-9832-433c-983c-4086c36b81a4-tls-certs\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.731878 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.731760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce67ee07-9832-433c-983c-4086c36b81a4-tmp\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.731878 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.731811 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtctj\" (UniqueName: \"kubernetes.io/projected/ce67ee07-9832-433c-983c-4086c36b81a4-kube-api-access-mtctj\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.832772 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.832673 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce67ee07-9832-433c-983c-4086c36b81a4-tls-certs\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.832955 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.832771 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce67ee07-9832-433c-983c-4086c36b81a4-tmp\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.832955 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.832810 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtctj\" (UniqueName: \"kubernetes.io/projected/ce67ee07-9832-433c-983c-4086c36b81a4-kube-api-access-mtctj\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.832955 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:24:31.832847 2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 24 03:24:31.832955 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:24:31.832922 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce67ee07-9832-433c-983c-4086c36b81a4-tls-certs podName:ce67ee07-9832-433c-983c-4086c36b81a4 nodeName:}" failed. No retries permitted until 2026-07-24 03:24:32.332898979 +0000 UTC m=+395.907548904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ce67ee07-9832-433c-983c-4086c36b81a4-tls-certs") pod "kube-auth-proxy-7ccbc5c95c-vf6lw" (UID: "ce67ee07-9832-433c-983c-4086c36b81a4") : secret "kube-auth-proxy-tls" not found Jul 24 03:24:31.835255 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.835224 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce67ee07-9832-433c-983c-4086c36b81a4-tmp\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.860296 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.860248 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtctj\" (UniqueName: \"kubernetes.io/projected/ce67ee07-9832-433c-983c-4086c36b81a4-kube-api-access-mtctj\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:31.914927 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.914892 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qtqhm"] Jul 24 03:24:31.917211 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.917193 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:31.919853 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.919815 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ftkvh\"" Jul 24 03:24:31.919979 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.919907 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 24 03:24:31.938485 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:31.938450 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qtqhm"] Jul 24 03:24:32.034578 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.034535 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lvj4\" (UniqueName: \"kubernetes.io/projected/b262659d-5b7c-4015-b783-ce0052275fea-kube-api-access-2lvj4\") pod \"odh-model-controller-7998c67dc4-qtqhm\" (UID: \"b262659d-5b7c-4015-b783-ce0052275fea\") " pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:32.034762 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.034624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b262659d-5b7c-4015-b783-ce0052275fea-cert\") pod \"odh-model-controller-7998c67dc4-qtqhm\" (UID: \"b262659d-5b7c-4015-b783-ce0052275fea\") " pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:32.135643 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.135539 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lvj4\" (UniqueName: \"kubernetes.io/projected/b262659d-5b7c-4015-b783-ce0052275fea-kube-api-access-2lvj4\") pod \"odh-model-controller-7998c67dc4-qtqhm\" (UID: \"b262659d-5b7c-4015-b783-ce0052275fea\") " pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:32.135823 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.135649 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b262659d-5b7c-4015-b783-ce0052275fea-cert\") pod \"odh-model-controller-7998c67dc4-qtqhm\" (UID: \"b262659d-5b7c-4015-b783-ce0052275fea\") " pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:32.135823 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:24:32.135780 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 24 03:24:32.135939 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:24:32.135854 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b262659d-5b7c-4015-b783-ce0052275fea-cert podName:b262659d-5b7c-4015-b783-ce0052275fea nodeName:}" failed. No retries permitted until 2026-07-24 03:24:32.635834895 +0000 UTC m=+396.210484824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b262659d-5b7c-4015-b783-ce0052275fea-cert") pod "odh-model-controller-7998c67dc4-qtqhm" (UID: "b262659d-5b7c-4015-b783-ce0052275fea") : secret "odh-model-controller-webhook-cert" not found Jul 24 03:24:32.152240 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.152201 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lvj4\" (UniqueName: \"kubernetes.io/projected/b262659d-5b7c-4015-b783-ce0052275fea-kube-api-access-2lvj4\") pod \"odh-model-controller-7998c67dc4-qtqhm\" (UID: \"b262659d-5b7c-4015-b783-ce0052275fea\") " pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:32.337434 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.337396 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce67ee07-9832-433c-983c-4086c36b81a4-tls-certs\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:32.340259 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.340220 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce67ee07-9832-433c-983c-4086c36b81a4-tls-certs\") pod \"kube-auth-proxy-7ccbc5c95c-vf6lw\" (UID: \"ce67ee07-9832-433c-983c-4086c36b81a4\") " pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:32.502779 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.502745 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" Jul 24 03:24:32.640831 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.640803 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b262659d-5b7c-4015-b783-ce0052275fea-cert\") pod \"odh-model-controller-7998c67dc4-qtqhm\" (UID: \"b262659d-5b7c-4015-b783-ce0052275fea\") " pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:32.643317 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.643298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b262659d-5b7c-4015-b783-ce0052275fea-cert\") pod \"odh-model-controller-7998c67dc4-qtqhm\" (UID: \"b262659d-5b7c-4015-b783-ce0052275fea\") " pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:32.659271 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.659138 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw"] Jul 24 03:24:32.661758 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:24:32.661730 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce67ee07_9832_433c_983c_4086c36b81a4.slice/crio-f433039457fef17d35fecb06223649c615a763762ce7b6befe1846f37d3cdbc8 WatchSource:0}: Error finding container f433039457fef17d35fecb06223649c615a763762ce7b6befe1846f37d3cdbc8: Status 404 returned error can't find the container with id f433039457fef17d35fecb06223649c615a763762ce7b6befe1846f37d3cdbc8 Jul 24 03:24:32.828316 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.828200 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:32.982918 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:32.982892 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-qtqhm"] Jul 24 03:24:32.987310 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:24:32.987256 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb262659d_5b7c_4015_b783_ce0052275fea.slice/crio-5cb73871fb31dd56adece1c76d5a8e3f863cb2b656aaf8169c8fd3f31cfa3174 WatchSource:0}: Error finding container 5cb73871fb31dd56adece1c76d5a8e3f863cb2b656aaf8169c8fd3f31cfa3174: Status 404 returned error can't find the container with id 5cb73871fb31dd56adece1c76d5a8e3f863cb2b656aaf8169c8fd3f31cfa3174 Jul 24 03:24:33.182492 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.182415 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6scqs"] Jul 24 03:24:33.185386 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.185364 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:33.189205 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.189183 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 24 03:24:33.189205 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.189200 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-cmn5l\"" Jul 24 03:24:33.219569 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.213332 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6scqs"] Jul 24 03:24:33.345573 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.345533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efa8c2d-c33e-468b-bad8-1c7f85397342-tls-certs\") pod \"model-serving-api-54d89bd5fc-6scqs\" (UID: \"4efa8c2d-c33e-468b-bad8-1c7f85397342\") " pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:33.345754 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.345717 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bd2h\" (UniqueName: \"kubernetes.io/projected/4efa8c2d-c33e-468b-bad8-1c7f85397342-kube-api-access-7bd2h\") pod \"model-serving-api-54d89bd5fc-6scqs\" (UID: \"4efa8c2d-c33e-468b-bad8-1c7f85397342\") " pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:33.447219 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.447123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bd2h\" (UniqueName: \"kubernetes.io/projected/4efa8c2d-c33e-468b-bad8-1c7f85397342-kube-api-access-7bd2h\") pod \"model-serving-api-54d89bd5fc-6scqs\" (UID: \"4efa8c2d-c33e-468b-bad8-1c7f85397342\") " pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:33.447219 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.447193 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efa8c2d-c33e-468b-bad8-1c7f85397342-tls-certs\") pod \"model-serving-api-54d89bd5fc-6scqs\" (UID: \"4efa8c2d-c33e-468b-bad8-1c7f85397342\") " pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:33.447467 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:24:33.447403 2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 24 03:24:33.447523 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:24:33.447474 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efa8c2d-c33e-468b-bad8-1c7f85397342-tls-certs podName:4efa8c2d-c33e-468b-bad8-1c7f85397342 nodeName:}" failed. No retries permitted until 2026-07-24 03:24:33.947453056 +0000 UTC m=+397.522102973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4efa8c2d-c33e-468b-bad8-1c7f85397342-tls-certs") pod "model-serving-api-54d89bd5fc-6scqs" (UID: "4efa8c2d-c33e-468b-bad8-1c7f85397342") : secret "model-serving-api-tls" not found Jul 24 03:24:33.463931 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.463867 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bd2h\" (UniqueName: \"kubernetes.io/projected/4efa8c2d-c33e-468b-bad8-1c7f85397342-kube-api-access-7bd2h\") pod \"model-serving-api-54d89bd5fc-6scqs\" (UID: \"4efa8c2d-c33e-468b-bad8-1c7f85397342\") " pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:33.469897 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.469867 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg"] Jul 24 03:24:33.474363 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.474299 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.477534 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.477511 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 03:24:33.477676 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.477565 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 03:24:33.477899 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.477785 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 03:24:33.478310 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.478240 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dtcht\"" Jul 24 03:24:33.478406 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.478318 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 03:24:33.493147 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.493110 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg"] Jul 24 03:24:33.548624 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.548588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.548813 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.548642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.548813 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.548730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.548897 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.548838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.548897 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.548885 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3b0a53-5000-4e9f-99bd-195790b0b082-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.548989 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.548921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.549043 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.548996 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf787\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-kube-api-access-tf787\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.650166 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.650124 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.650676 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.650186 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3b0a53-5000-4e9f-99bd-195790b0b082-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.650676 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.650221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.650676 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.650245 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf787\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-kube-api-access-tf787\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.650676 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.650296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.650676 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.650328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.650676 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.650374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.651593 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.651562 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.652887 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.652864 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.652887 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.652875 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3b0a53-5000-4e9f-99bd-195790b0b082-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.653005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.652972 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.653061 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.653045 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.670037 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.670002 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" event={"ID":"b262659d-5b7c-4015-b783-ce0052275fea","Type":"ContainerStarted","Data":"5cb73871fb31dd56adece1c76d5a8e3f863cb2b656aaf8169c8fd3f31cfa3174"} Jul 24 03:24:33.671095 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.671074 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" event={"ID":"ce67ee07-9832-433c-983c-4086c36b81a4","Type":"ContainerStarted","Data":"f433039457fef17d35fecb06223649c615a763762ce7b6befe1846f37d3cdbc8"} Jul 24 03:24:33.674102 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.674083 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.674340 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.674321 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf787\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-kube-api-access-tf787\") pod \"istiod-openshift-gateway-7b7995d5cd-928qg\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.786755 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.786721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:33.954140 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.954099 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efa8c2d-c33e-468b-bad8-1c7f85397342-tls-certs\") pod \"model-serving-api-54d89bd5fc-6scqs\" (UID: \"4efa8c2d-c33e-468b-bad8-1c7f85397342\") " pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:33.957753 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.957699 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4efa8c2d-c33e-468b-bad8-1c7f85397342-tls-certs\") pod \"model-serving-api-54d89bd5fc-6scqs\" (UID: \"4efa8c2d-c33e-468b-bad8-1c7f85397342\") " pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:33.978807 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:33.977016 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg"] Jul 24 03:24:33.983168 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:24:33.983131 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3b0a53_5000_4e9f_99bd_195790b0b082.slice/crio-71e33a75a6a7f11c5bfa458077e7f49c34861f2e6f7bfc986bc554da4812df8d WatchSource:0}: Error finding container 71e33a75a6a7f11c5bfa458077e7f49c34861f2e6f7bfc986bc554da4812df8d: Status 404 returned error can't find the container with id 71e33a75a6a7f11c5bfa458077e7f49c34861f2e6f7bfc986bc554da4812df8d Jul 24 03:24:34.095764 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:34.095673 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:34.314307 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:34.314033 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6scqs"] Jul 24 03:24:34.316754 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:24:34.316725 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efa8c2d_c33e_468b_bad8_1c7f85397342.slice/crio-a1959824b9241bb7300b76758ae9e00daa8992cc0a9189539254dae852b3a10d WatchSource:0}: Error finding container a1959824b9241bb7300b76758ae9e00daa8992cc0a9189539254dae852b3a10d: Status 404 returned error can't find the container with id a1959824b9241bb7300b76758ae9e00daa8992cc0a9189539254dae852b3a10d Jul 24 03:24:34.680146 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:34.680059 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" event={"ID":"5c3b0a53-5000-4e9f-99bd-195790b0b082","Type":"ContainerStarted","Data":"71e33a75a6a7f11c5bfa458077e7f49c34861f2e6f7bfc986bc554da4812df8d"} Jul 24 03:24:34.682162 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:34.682012 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" event={"ID":"4efa8c2d-c33e-468b-bad8-1c7f85397342","Type":"ContainerStarted","Data":"a1959824b9241bb7300b76758ae9e00daa8992cc0a9189539254dae852b3a10d"} Jul 24 03:24:37.698663 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:37.698625 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" event={"ID":"b262659d-5b7c-4015-b783-ce0052275fea","Type":"ContainerStarted","Data":"0325cc5c230bcb1b4929b3500190027fa9ea6d586a7fbd3808982a1be6c46e29"} Jul 24 03:24:37.699077 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:37.698745 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:37.700363 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:37.700333 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" event={"ID":"ce67ee07-9832-433c-983c-4086c36b81a4","Type":"ContainerStarted","Data":"30966bc61f746dd16d1c3d7f73fda51293d9743230237fa644e53248916cca59"} Jul 24 03:24:37.717185 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:37.717101 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" podStartSLOduration=2.7176115039999997 podStartE2EDuration="6.71708003s" totalImagesPullingTime="3.999468526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:37.714136089 +0000 UTC m=+401.288786024" watchObservedRunningTime="2026-07-24 03:24:37.71708003 +0000 UTC m=+401.291729957" Jul 24 03:24:37.732558 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:37.732499 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7ccbc5c95c-vf6lw" podStartSLOduration=2.4617716 podStartE2EDuration="6.732475449s" totalImagesPullingTime="4.270703849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:37.730999372 +0000 UTC m=+401.305649305" watchObservedRunningTime="2026-07-24 03:24:37.732475449 +0000 UTC m=+401.307125381" Jul 24 03:24:38.716372 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:38.716337 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 24 03:24:38.716686 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:38.716404 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 24 03:24:39.715191 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:39.715092 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" event={"ID":"5c3b0a53-5000-4e9f-99bd-195790b0b082","Type":"ContainerStarted","Data":"8aaa7a39e395adc59bf6b85ed683ad1c207e3e6d0b3f1eba4ff717b868ec6046"} Jul 24 03:24:39.715406 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:39.715262 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:39.717107 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:39.717078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" event={"ID":"4efa8c2d-c33e-468b-bad8-1c7f85397342","Type":"ContainerStarted","Data":"99f0a4b1d890d9bc337100095ac48a42ca4008d15fa88696c23e461fce144be9"} Jul 24 03:24:39.717578 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:39.717523 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:24:39.717669 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:39.717650 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-928qg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 03:24:39.717780 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:39.717728 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" podUID="5c3b0a53-5000-4e9f-99bd-195790b0b082" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 03:24:39.739743 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:39.739686 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" podStartSLOduration=2.009463632 podStartE2EDuration="6.739671263s" totalImagesPullingTime="4.730207631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:39.737543288 +0000 UTC m=+403.312193261" watchObservedRunningTime="2026-07-24 03:24:39.739671263 +0000 UTC m=+403.314321196" Jul 24 03:24:39.758934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:39.758884 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" podStartSLOduration=2.421179687 podStartE2EDuration="6.758871025s" totalImagesPullingTime="4.337691338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:39.758334814 +0000 UTC m=+403.332984769" watchObservedRunningTime="2026-07-24 03:24:39.758871025 +0000 UTC m=+403.333520987" Jul 24 03:24:40.723928 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:40.723892 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:43.631151 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.631115 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nztmv"] Jul 24 03:24:43.634905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.634882 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:43.637555 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.637528 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 24 03:24:43.637674 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.637577 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lhkhb\"" Jul 24 03:24:43.647642 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.647617 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nztmv"] Jul 24 03:24:43.654595 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.654553 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps"] Jul 24 03:24:43.658333 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.658312 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:43.661124 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.661098 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 24 03:24:43.661124 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.661109 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-l9cfk\"" Jul 24 03:24:43.673435 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.673402 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps"] Jul 24 03:24:43.745930 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.745901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d08b636d-7425-475c-964c-4e9c97192adb-cert\") pod \"kserve-controller-manager-d6f4b65b8-nztmv\" (UID: \"d08b636d-7425-475c-964c-4e9c97192adb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:43.746098 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.745961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrnsr\" (UniqueName: \"kubernetes.io/projected/d08b636d-7425-475c-964c-4e9c97192adb-kube-api-access-xrnsr\") pod \"kserve-controller-manager-d6f4b65b8-nztmv\" (UID: \"d08b636d-7425-475c-964c-4e9c97192adb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:43.847400 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.847359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d08b636d-7425-475c-964c-4e9c97192adb-cert\") pod \"kserve-controller-manager-d6f4b65b8-nztmv\" (UID: \"d08b636d-7425-475c-964c-4e9c97192adb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:43.847400 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.847407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6f68458-e863-492c-8a6c-5b7c88ca9dee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qx9ps\" (UID: \"f6f68458-e863-492c-8a6c-5b7c88ca9dee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:43.847622 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.847437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js4wq\" (UniqueName: \"kubernetes.io/projected/f6f68458-e863-492c-8a6c-5b7c88ca9dee-kube-api-access-js4wq\") pod \"llmisvc-controller-manager-777c6bd7d5-qx9ps\" (UID: \"f6f68458-e863-492c-8a6c-5b7c88ca9dee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:43.847622 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.847488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrnsr\" (UniqueName: \"kubernetes.io/projected/d08b636d-7425-475c-964c-4e9c97192adb-kube-api-access-xrnsr\") pod \"kserve-controller-manager-d6f4b65b8-nztmv\" (UID: \"d08b636d-7425-475c-964c-4e9c97192adb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:43.850195 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.850154 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d08b636d-7425-475c-964c-4e9c97192adb-cert\") pod \"kserve-controller-manager-d6f4b65b8-nztmv\" (UID: \"d08b636d-7425-475c-964c-4e9c97192adb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:43.860060 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.860032 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrnsr\" (UniqueName: \"kubernetes.io/projected/d08b636d-7425-475c-964c-4e9c97192adb-kube-api-access-xrnsr\") pod \"kserve-controller-manager-d6f4b65b8-nztmv\" (UID: \"d08b636d-7425-475c-964c-4e9c97192adb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:43.946132 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.946044 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:43.948458 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.948429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6f68458-e863-492c-8a6c-5b7c88ca9dee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qx9ps\" (UID: \"f6f68458-e863-492c-8a6c-5b7c88ca9dee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:43.948593 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.948466 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js4wq\" (UniqueName: \"kubernetes.io/projected/f6f68458-e863-492c-8a6c-5b7c88ca9dee-kube-api-access-js4wq\") pod \"llmisvc-controller-manager-777c6bd7d5-qx9ps\" (UID: \"f6f68458-e863-492c-8a6c-5b7c88ca9dee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:43.951084 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.951061 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6f68458-e863-492c-8a6c-5b7c88ca9dee-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qx9ps\" (UID: \"f6f68458-e863-492c-8a6c-5b7c88ca9dee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:43.959452 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.959429 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js4wq\" (UniqueName: \"kubernetes.io/projected/f6f68458-e863-492c-8a6c-5b7c88ca9dee-kube-api-access-js4wq\") pod \"llmisvc-controller-manager-777c6bd7d5-qx9ps\" (UID: \"f6f68458-e863-492c-8a6c-5b7c88ca9dee\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:43.968944 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:43.968919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:44.109763 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:44.109737 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nztmv"] Jul 24 03:24:44.112176 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:24:44.112150 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08b636d_7425_475c_964c_4e9c97192adb.slice/crio-18a496a12ed0a087b53ccdc0572f716f6e2a343a5aa8ca5189484534d1d452aa WatchSource:0}: Error finding container 18a496a12ed0a087b53ccdc0572f716f6e2a343a5aa8ca5189484534d1d452aa: Status 404 returned error can't find the container with id 18a496a12ed0a087b53ccdc0572f716f6e2a343a5aa8ca5189484534d1d452aa Jul 24 03:24:44.134487 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:44.134466 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps"] Jul 24 03:24:44.136180 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:24:44.136156 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf6f68458_e863_492c_8a6c_5b7c88ca9dee.slice/crio-a1b25bb2741352fd0bc552e33b3a0b4e7b97de2b359ce8b0132830fc9c438f1a WatchSource:0}: Error finding container a1b25bb2741352fd0bc552e33b3a0b4e7b97de2b359ce8b0132830fc9c438f1a: Status 404 returned error can't find the container with id a1b25bb2741352fd0bc552e33b3a0b4e7b97de2b359ce8b0132830fc9c438f1a Jul 24 03:24:44.751363 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:44.751326 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" event={"ID":"f6f68458-e863-492c-8a6c-5b7c88ca9dee","Type":"ContainerStarted","Data":"a1b25bb2741352fd0bc552e33b3a0b4e7b97de2b359ce8b0132830fc9c438f1a"} Jul 24 03:24:44.752657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:44.752630 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" event={"ID":"d08b636d-7425-475c-964c-4e9c97192adb","Type":"ContainerStarted","Data":"18a496a12ed0a087b53ccdc0572f716f6e2a343a5aa8ca5189484534d1d452aa"} Jul 24 03:24:45.903678 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:45.903037 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg"] Jul 24 03:24:45.903678 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:45.903315 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" podUID="5c3b0a53-5000-4e9f-99bd-195790b0b082" containerName="discovery" containerID="cri-o://8aaa7a39e395adc59bf6b85ed683ad1c207e3e6d0b3f1eba4ff717b868ec6046" gracePeriod=30 Jul 24 03:24:46.765407 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:46.765376 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c3b0a53-5000-4e9f-99bd-195790b0b082" containerID="8aaa7a39e395adc59bf6b85ed683ad1c207e3e6d0b3f1eba4ff717b868ec6046" exitCode=0 Jul 24 03:24:46.765604 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:46.765463 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" event={"ID":"5c3b0a53-5000-4e9f-99bd-195790b0b082","Type":"ContainerDied","Data":"8aaa7a39e395adc59bf6b85ed683ad1c207e3e6d0b3f1eba4ff717b868ec6046"} Jul 24 03:24:47.034654 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.034632 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:47.078759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.078728 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf787\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-kube-api-access-tf787\") pod \"5c3b0a53-5000-4e9f-99bd-195790b0b082\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " Jul 24 03:24:47.078866 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.078800 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-dns-cert\") pod \"5c3b0a53-5000-4e9f-99bd-195790b0b082\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " Jul 24 03:24:47.078866 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.078837 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-token\") pod \"5c3b0a53-5000-4e9f-99bd-195790b0b082\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " Jul 24 03:24:47.078971 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.078900 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-ca-configmap\") pod \"5c3b0a53-5000-4e9f-99bd-195790b0b082\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " Jul 24 03:24:47.078971 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.078933 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-kubeconfig\") pod \"5c3b0a53-5000-4e9f-99bd-195790b0b082\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " Jul 24 03:24:47.079071 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.078971 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3b0a53-5000-4e9f-99bd-195790b0b082-local-certs\") pod \"5c3b0a53-5000-4e9f-99bd-195790b0b082\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " Jul 24 03:24:47.079071 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.079005 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-cacerts\") pod \"5c3b0a53-5000-4e9f-99bd-195790b0b082\" (UID: \"5c3b0a53-5000-4e9f-99bd-195790b0b082\") " Jul 24 03:24:47.079373 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.079346 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5c3b0a53-5000-4e9f-99bd-195790b0b082" (UID: "5c3b0a53-5000-4e9f-99bd-195790b0b082"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:24:47.081528 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.081495 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-token" (OuterVolumeSpecName: "istio-token") pod "5c3b0a53-5000-4e9f-99bd-195790b0b082" (UID: "5c3b0a53-5000-4e9f-99bd-195790b0b082"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:24:47.081707 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.081675 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5c3b0a53-5000-4e9f-99bd-195790b0b082" (UID: "5c3b0a53-5000-4e9f-99bd-195790b0b082"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:24:47.081707 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.081687 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5c3b0a53-5000-4e9f-99bd-195790b0b082" (UID: "5c3b0a53-5000-4e9f-99bd-195790b0b082"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:24:47.081841 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.081771 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-kube-api-access-tf787" (OuterVolumeSpecName: "kube-api-access-tf787") pod "5c3b0a53-5000-4e9f-99bd-195790b0b082" (UID: "5c3b0a53-5000-4e9f-99bd-195790b0b082"). InnerVolumeSpecName "kube-api-access-tf787". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:24:47.081889 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.081877 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-cacerts" (OuterVolumeSpecName: "cacerts") pod "5c3b0a53-5000-4e9f-99bd-195790b0b082" (UID: "5c3b0a53-5000-4e9f-99bd-195790b0b082"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:24:47.081924 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.081889 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c3b0a53-5000-4e9f-99bd-195790b0b082-local-certs" (OuterVolumeSpecName: "local-certs") pod "5c3b0a53-5000-4e9f-99bd-195790b0b082" (UID: "5c3b0a53-5000-4e9f-99bd-195790b0b082"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:24:47.179574 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.179540 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-dns-cert\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:24:47.179574 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.179568 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-token\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:24:47.179574 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.179578 2559 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-csr-ca-configmap\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:24:47.179799 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.179587 2559 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-istio-kubeconfig\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:24:47.179799 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.179596 2559 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c3b0a53-5000-4e9f-99bd-195790b0b082-local-certs\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:24:47.179799 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.179604 2559 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5c3b0a53-5000-4e9f-99bd-195790b0b082-cacerts\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:24:47.179799 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.179613 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf787\" (UniqueName: \"kubernetes.io/projected/5c3b0a53-5000-4e9f-99bd-195790b0b082-kube-api-access-tf787\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:24:47.771429 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.771404 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" Jul 24 03:24:47.771622 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.771402 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" event={"ID":"5c3b0a53-5000-4e9f-99bd-195790b0b082","Type":"ContainerDied","Data":"71e33a75a6a7f11c5bfa458077e7f49c34861f2e6f7bfc986bc554da4812df8d"} Jul 24 03:24:47.771622 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.771555 2559 scope.go:117] "RemoveContainer" containerID="8aaa7a39e395adc59bf6b85ed683ad1c207e3e6d0b3f1eba4ff717b868ec6046" Jul 24 03:24:47.773040 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.773013 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" event={"ID":"f6f68458-e863-492c-8a6c-5b7c88ca9dee","Type":"ContainerStarted","Data":"f587d9a61f139e09d85890d49170cedcfed94f4f140c35548a9f2cba6e46ebeb"} Jul 24 03:24:47.773245 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.773168 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:24:47.774857 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.774819 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" event={"ID":"d08b636d-7425-475c-964c-4e9c97192adb","Type":"ContainerStarted","Data":"8fc8deddfddf9d2d8187839b420225f20c6b02cf219e9fd7a1ff00e858a1c8e5"} Jul 24 03:24:47.774958 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.774887 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:24:47.796046 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.796007 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" podStartSLOduration=1.885650516 podStartE2EDuration="4.795993745s" totalImagesPullingTime="2.910343229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:47.794911343 +0000 UTC m=+411.369561288" watchObservedRunningTime="2026-07-24 03:24:47.795993745 +0000 UTC m=+411.370643676" Jul 24 03:24:47.817110 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.817054 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" podStartSLOduration=1.875967452 podStartE2EDuration="4.817037886s" totalImagesPullingTime="2.941070434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:24:47.814786024 +0000 UTC m=+411.389435973" watchObservedRunningTime="2026-07-24 03:24:47.817037886 +0000 UTC m=+411.391687836" Jul 24 03:24:47.834394 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.834365 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg"] Jul 24 03:24:47.839472 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:47.839437 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg"] Jul 24 03:24:48.710828 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:48.710801 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-qtqhm" Jul 24 03:24:48.906059 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:48.906027 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c3b0a53-5000-4e9f-99bd-195790b0b082" path="/var/lib/kubelet/pods/5c3b0a53-5000-4e9f-99bd-195790b0b082/volumes" Jul 24 03:24:51.723883 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:51.723844 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-928qg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.27:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 24 03:24:51.724396 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:51.723916 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-928qg" podUID="5c3b0a53-5000-4e9f-99bd-195790b0b082" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.27:8080/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 24 03:24:51.731696 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:24:51.731657 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6scqs" Jul 24 03:25:18.782823 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:18.782745 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qx9ps" Jul 24 03:25:18.785700 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:18.785677 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nztmv" Jul 24 03:25:32.598731 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.598696 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpgwf"] Jul 24 03:25:32.599177 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.599027 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c3b0a53-5000-4e9f-99bd-195790b0b082" containerName="discovery" Jul 24 03:25:32.599177 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.599037 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c3b0a53-5000-4e9f-99bd-195790b0b082" containerName="discovery" Jul 24 03:25:32.599177 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.599097 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c3b0a53-5000-4e9f-99bd-195790b0b082" containerName="discovery" Jul 24 03:25:32.605244 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.605213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:32.608452 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.608430 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 03:25:32.608758 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.608741 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 03:25:32.610735 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.610717 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lb5d9\"" Jul 24 03:25:32.692172 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.692139 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpgwf"] Jul 24 03:25:32.753340 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.753303 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sfvg\" (UniqueName: \"kubernetes.io/projected/7fb2569f-40ab-4946-a6de-314c4d8bef5a-kube-api-access-4sfvg\") pod \"kuadrant-operator-catalog-bpgwf\" (UID: \"7fb2569f-40ab-4946-a6de-314c4d8bef5a\") " pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:32.854569 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.854472 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sfvg\" (UniqueName: \"kubernetes.io/projected/7fb2569f-40ab-4946-a6de-314c4d8bef5a-kube-api-access-4sfvg\") pod \"kuadrant-operator-catalog-bpgwf\" (UID: \"7fb2569f-40ab-4946-a6de-314c4d8bef5a\") " pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:32.891301 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.891239 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sfvg\" (UniqueName: \"kubernetes.io/projected/7fb2569f-40ab-4946-a6de-314c4d8bef5a-kube-api-access-4sfvg\") pod \"kuadrant-operator-catalog-bpgwf\" (UID: \"7fb2569f-40ab-4946-a6de-314c4d8bef5a\") " pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:32.915662 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:32.915632 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:33.063405 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:33.063382 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bpgwf"] Jul 24 03:25:33.066426 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:25:33.066399 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb2569f_40ab_4946_a6de_314c4d8bef5a.slice/crio-7c5f97ee01a1b3dcf2bc06dbec2997309861b6888dd72caf31663c46b0bc7a6f WatchSource:0}: Error finding container 7c5f97ee01a1b3dcf2bc06dbec2997309861b6888dd72caf31663c46b0bc7a6f: Status 404 returned error can't find the container with id 7c5f97ee01a1b3dcf2bc06dbec2997309861b6888dd72caf31663c46b0bc7a6f Jul 24 03:25:33.974025 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:33.973992 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" event={"ID":"7fb2569f-40ab-4946-a6de-314c4d8bef5a","Type":"ContainerStarted","Data":"7c5f97ee01a1b3dcf2bc06dbec2997309861b6888dd72caf31663c46b0bc7a6f"} Jul 24 03:25:35.985397 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:35.985364 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" event={"ID":"7fb2569f-40ab-4946-a6de-314c4d8bef5a","Type":"ContainerStarted","Data":"186e691327abe3f11147f2ee9292974facafc101911090bcd9b65cd27b00906a"} Jul 24 03:25:36.000752 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:36.000698 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" podStartSLOduration=2.0768405149999998 podStartE2EDuration="4.000680528s" totalImagesPullingTime="1.923840013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:25:35.999750202 +0000 UTC m=+459.574400155" watchObservedRunningTime="2026-07-24 03:25:36.000680528 +0000 UTC m=+459.575330487" Jul 24 03:25:42.915821 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:42.915791 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:42.916267 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:42.915858 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:42.938726 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:42.938702 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:43.037163 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:43.037137 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-bpgwf" Jul 24 03:25:58.749457 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:58.749422 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gskz"] Jul 24 03:25:58.752825 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:58.752809 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" Jul 24 03:25:58.760588 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:25:58.760559 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"authorino-operator-75cc8d5cb7-8gskz\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="33399732-fa01-4478-835d-7e57efd3c10d" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" Jul 24 03:25:58.760671 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:25:58.760592 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"authorino-operator-dockercfg-nxqhq\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nxqhq\"" type="*v1.Secret" Jul 24 03:25:58.800026 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:58.799997 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gskz"] Jul 24 03:25:58.849453 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:58.849401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9549k\" (UniqueName: \"kubernetes.io/projected/33399732-fa01-4478-835d-7e57efd3c10d-kube-api-access-9549k\") pod \"authorino-operator-75cc8d5cb7-8gskz\" (UID: \"33399732-fa01-4478-835d-7e57efd3c10d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" Jul 24 03:25:58.950771 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:58.950719 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9549k\" (UniqueName: \"kubernetes.io/projected/33399732-fa01-4478-835d-7e57efd3c10d-kube-api-access-9549k\") pod \"authorino-operator-75cc8d5cb7-8gskz\" (UID: \"33399732-fa01-4478-835d-7e57efd3c10d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" Jul 24 03:25:58.971499 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:25:58.971474 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9549k\" (UniqueName: \"kubernetes.io/projected/33399732-fa01-4478-835d-7e57efd3c10d-kube-api-access-9549k\") pod \"authorino-operator-75cc8d5cb7-8gskz\" (UID: \"33399732-fa01-4478-835d-7e57efd3c10d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" Jul 24 03:26:00.063360 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:00.063324 2559 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jul 24 03:26:00.063747 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:00.063402 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" Jul 24 03:26:00.133523 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:00.133497 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nxqhq\"" Jul 24 03:26:00.214296 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:00.214245 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8gskz"] Jul 24 03:26:00.216322 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:26:00.216297 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33399732_fa01_4478_835d_7e57efd3c10d.slice/crio-efa33b7bbc9d13e3b2fb22ebe145978c322e2f60dfb9ff7c1263cc7a02b3b392 WatchSource:0}: Error finding container efa33b7bbc9d13e3b2fb22ebe145978c322e2f60dfb9ff7c1263cc7a02b3b392: Status 404 returned error can't find the container with id efa33b7bbc9d13e3b2fb22ebe145978c322e2f60dfb9ff7c1263cc7a02b3b392 Jul 24 03:26:01.095360 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:01.095318 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" event={"ID":"33399732-fa01-4478-835d-7e57efd3c10d","Type":"ContainerStarted","Data":"efa33b7bbc9d13e3b2fb22ebe145978c322e2f60dfb9ff7c1263cc7a02b3b392"} Jul 24 03:26:02.983031 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:02.982991 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z"] Jul 24 03:26:02.987738 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:02.987709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" Jul 24 03:26:02.993115 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:02.993072 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"dns-operator-controller-manager-864dd78c4c-7lj2z\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="7512a4cf-a34d-413a-b039-ff290a4e377b" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" Jul 24 03:26:02.993115 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:02.993094 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-operator-controller-manager-dockercfg-xdnq4\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xdnq4\"" type="*v1.Secret" Jul 24 03:26:02.993455 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:02.993432 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dns-operator-controller-env\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" type="*v1.ConfigMap" Jul 24 03:26:03.013523 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:03.013494 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z"] Jul 24 03:26:03.088374 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:03.088337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktd4v\" (UniqueName: \"kubernetes.io/projected/7512a4cf-a34d-413a-b039-ff290a4e377b-kube-api-access-ktd4v\") pod \"dns-operator-controller-manager-864dd78c4c-7lj2z\" (UID: \"7512a4cf-a34d-413a-b039-ff290a4e377b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" Jul 24 03:26:03.106722 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:03.106684 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" event={"ID":"33399732-fa01-4478-835d-7e57efd3c10d","Type":"ContainerStarted","Data":"61460bc06d97e44e4c6c993ae129e2594255a88ee0345ad8046e46cc61001a68"} Jul 24 03:26:03.106880 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:03.106823 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" Jul 24 03:26:03.146412 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:03.146362 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" podStartSLOduration=2.869386543 podStartE2EDuration="5.14634502s" totalImagesPullingTime="2.276958477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:26:03.144318875 +0000 UTC m=+486.718968829" watchObservedRunningTime="2026-07-24 03:26:03.14634502 +0000 UTC m=+486.720995366" Jul 24 03:26:03.188967 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:03.188926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktd4v\" (UniqueName: \"kubernetes.io/projected/7512a4cf-a34d-413a-b039-ff290a4e377b-kube-api-access-ktd4v\") pod \"dns-operator-controller-manager-864dd78c4c-7lj2z\" (UID: \"7512a4cf-a34d-413a-b039-ff290a4e377b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" Jul 24 03:26:03.204253 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:03.204224 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktd4v\" (UniqueName: \"kubernetes.io/projected/7512a4cf-a34d-413a-b039-ff290a4e377b-kube-api-access-ktd4v\") pod \"dns-operator-controller-manager-864dd78c4c-7lj2z\" (UID: \"7512a4cf-a34d-413a-b039-ff290a4e377b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" Jul 24 03:26:04.015045 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:04.015017 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xdnq4\"" Jul 24 03:26:04.018121 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:04.018106 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" Jul 24 03:26:04.101240 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:04.101215 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 24 03:26:04.165524 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:04.165503 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z"] Jul 24 03:26:04.167743 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:26:04.167715 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7512a4cf_a34d_413a_b039_ff290a4e377b.slice/crio-87f825f0474a04af139bec51dd5d4e4439e1d05844b396a4df89a7ae54af3427 WatchSource:0}: Error finding container 87f825f0474a04af139bec51dd5d4e4439e1d05844b396a4df89a7ae54af3427: Status 404 returned error can't find the container with id 87f825f0474a04af139bec51dd5d4e4439e1d05844b396a4df89a7ae54af3427 Jul 24 03:26:04.888309 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:04.888252 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx"] Jul 24 03:26:04.891805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:04.891774 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:04.894797 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:04.894772 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z7pkh\"" Jul 24 03:26:04.912310 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:04.912266 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx"] Jul 24 03:26:05.004104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:05.004003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9295r\" (UniqueName: \"kubernetes.io/projected/a442a629-97b6-43c0-921e-6596f22bc4b1-kube-api-access-9295r\") pod \"limitador-operator-controller-manager-859d7b78bd-jnzgx\" (UID: \"a442a629-97b6-43c0-921e-6596f22bc4b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:05.104970 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:05.104939 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9295r\" (UniqueName: \"kubernetes.io/projected/a442a629-97b6-43c0-921e-6596f22bc4b1-kube-api-access-9295r\") pod \"limitador-operator-controller-manager-859d7b78bd-jnzgx\" (UID: \"a442a629-97b6-43c0-921e-6596f22bc4b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:05.120516 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:05.120479 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" event={"ID":"7512a4cf-a34d-413a-b039-ff290a4e377b","Type":"ContainerStarted","Data":"87f825f0474a04af139bec51dd5d4e4439e1d05844b396a4df89a7ae54af3427"} Jul 24 03:26:05.136172 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:05.136137 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9295r\" (UniqueName: \"kubernetes.io/projected/a442a629-97b6-43c0-921e-6596f22bc4b1-kube-api-access-9295r\") pod \"limitador-operator-controller-manager-859d7b78bd-jnzgx\" (UID: \"a442a629-97b6-43c0-921e-6596f22bc4b1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:05.206835 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:05.206748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:05.505409 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:05.505384 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx"] Jul 24 03:26:05.768674 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:26:05.768595 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda442a629_97b6_43c0_921e_6596f22bc4b1.slice/crio-61a1aaf0ff5335fb6212cb662e1d11f18cc3fe273a05ace5db36f8aa8d724a99 WatchSource:0}: Error finding container 61a1aaf0ff5335fb6212cb662e1d11f18cc3fe273a05ace5db36f8aa8d724a99: Status 404 returned error can't find the container with id 61a1aaf0ff5335fb6212cb662e1d11f18cc3fe273a05ace5db36f8aa8d724a99 Jul 24 03:26:06.127617 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:06.127516 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" event={"ID":"7512a4cf-a34d-413a-b039-ff290a4e377b","Type":"ContainerStarted","Data":"4b4c682bf10f668a32b27335f219a7a0d93892bd50636b8dcc7b0c338edfbc03"} Jul 24 03:26:06.127617 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:06.127580 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" Jul 24 03:26:06.128694 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:06.128670 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" event={"ID":"a442a629-97b6-43c0-921e-6596f22bc4b1","Type":"ContainerStarted","Data":"61a1aaf0ff5335fb6212cb662e1d11f18cc3fe273a05ace5db36f8aa8d724a99"} Jul 24 03:26:08.142606 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:08.142574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" event={"ID":"a442a629-97b6-43c0-921e-6596f22bc4b1","Type":"ContainerStarted","Data":"194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584"} Jul 24 03:26:08.143001 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:08.142721 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:08.180720 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:08.180659 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" podStartSLOduration=2.449743147 podStartE2EDuration="4.180638074s" totalImagesPullingTime="1.730894927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:26:08.180383369 +0000 UTC m=+491.755033302" watchObservedRunningTime="2026-07-24 03:26:08.180638074 +0000 UTC m=+491.755288009" Jul 24 03:26:08.181843 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:08.181807 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" podStartSLOduration=4.534562932 podStartE2EDuration="6.181795453s" totalImagesPullingTime="1.647232521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:26:06.188044621 +0000 UTC m=+489.762694554" watchObservedRunningTime="2026-07-24 03:26:08.181795453 +0000 UTC m=+491.756445385" Jul 24 03:26:09.096243 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.096207 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb"] Jul 24 03:26:09.102886 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.102863 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:09.106214 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.106195 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-769mn\"" Jul 24 03:26:09.139819 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.139787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9c1314e-efb7-422f-8107-07966ce31024-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" (UID: \"e9c1314e-efb7-422f-8107-07966ce31024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:09.139979 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.139837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlxtk\" (UniqueName: \"kubernetes.io/projected/e9c1314e-efb7-422f-8107-07966ce31024-kube-api-access-vlxtk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" (UID: \"e9c1314e-efb7-422f-8107-07966ce31024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:09.193766 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.193737 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb"] Jul 24 03:26:09.241132 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.241099 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9c1314e-efb7-422f-8107-07966ce31024-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" (UID: \"e9c1314e-efb7-422f-8107-07966ce31024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:09.241323 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.241159 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlxtk\" (UniqueName: \"kubernetes.io/projected/e9c1314e-efb7-422f-8107-07966ce31024-kube-api-access-vlxtk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" (UID: \"e9c1314e-efb7-422f-8107-07966ce31024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:09.241505 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.241487 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9c1314e-efb7-422f-8107-07966ce31024-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" (UID: \"e9c1314e-efb7-422f-8107-07966ce31024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:09.265838 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.265803 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlxtk\" (UniqueName: \"kubernetes.io/projected/e9c1314e-efb7-422f-8107-07966ce31024-kube-api-access-vlxtk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" (UID: \"e9c1314e-efb7-422f-8107-07966ce31024\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:09.413064 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.412978 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:09.571943 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:09.571917 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb"] Jul 24 03:26:09.574568 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:26:09.574538 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c1314e_efb7_422f_8107_07966ce31024.slice/crio-dd99a06b3d4d086dc0a008b4da4fef345699e6ef3694a806c5b9cae82a59687d WatchSource:0}: Error finding container dd99a06b3d4d086dc0a008b4da4fef345699e6ef3694a806c5b9cae82a59687d: Status 404 returned error can't find the container with id dd99a06b3d4d086dc0a008b4da4fef345699e6ef3694a806c5b9cae82a59687d Jul 24 03:26:10.152242 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:10.152210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" event={"ID":"e9c1314e-efb7-422f-8107-07966ce31024","Type":"ContainerStarted","Data":"dd99a06b3d4d086dc0a008b4da4fef345699e6ef3694a806c5b9cae82a59687d"} Jul 24 03:26:14.115439 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:14.115409 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8gskz" Jul 24 03:26:15.179289 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:15.179240 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" event={"ID":"e9c1314e-efb7-422f-8107-07966ce31024","Type":"ContainerStarted","Data":"80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563"} Jul 24 03:26:15.179689 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:15.179340 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:17.137548 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:17.137514 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-7lj2z" Jul 24 03:26:17.163953 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:17.163899 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" podStartSLOduration=3.209450531 podStartE2EDuration="8.163881588s" totalImagesPullingTime="4.954431057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:26:15.233801117 +0000 UTC m=+498.808451049" watchObservedRunningTime="2026-07-24 03:26:17.163881588 +0000 UTC m=+500.738531520" Jul 24 03:26:19.148939 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:19.148910 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:26.186892 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:26.186857 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:28.135258 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.135224 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb"] Jul 24 03:26:28.135691 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.135421 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" podUID="e9c1314e-efb7-422f-8107-07966ce31024" containerName="manager" containerID="cri-o://80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563" gracePeriod=2 Jul 24 03:26:28.141254 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.141225 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb"] Jul 24 03:26:28.163026 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.162997 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx"] Jul 24 03:26:28.163213 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.163193 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" containerName="manager" containerID="cri-o://194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584" gracePeriod=2 Jul 24 03:26:28.166102 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.166064 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="e9c1314e-efb7-422f-8107-07966ce31024" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:28.172021 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.171994 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv"] Jul 24 03:26:28.172432 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.172411 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c1314e-efb7-422f-8107-07966ce31024" containerName="manager" Jul 24 03:26:28.172432 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.172432 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c1314e-efb7-422f-8107-07966ce31024" containerName="manager" Jul 24 03:26:28.172634 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.172523 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9c1314e-efb7-422f-8107-07966ce31024" containerName="manager" Jul 24 03:26:28.175604 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.175581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:28.189385 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.189358 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx"] Jul 24 03:26:28.218839 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.213770 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a442a629-97b6-43c0-921e-6596f22bc4b1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-jnzgx\": pods \"limitador-operator-controller-manager-859d7b78bd-jnzgx\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:28.218839 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.218543 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="e9c1314e-efb7-422f-8107-07966ce31024" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:28.226306 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.223461 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jnzgx\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:28.231307 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.231185 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv"] Jul 24 03:26:28.233153 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.233124 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c"] Jul 24 03:26:28.233711 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.233696 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" containerName="manager" Jul 24 03:26:28.233807 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.233716 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" containerName="manager" Jul 24 03:26:28.233807 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.233803 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" containerName="manager" Jul 24 03:26:28.236978 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.236959 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" Jul 24 03:26:28.252708 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.252680 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c"] Jul 24 03:26:28.255508 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.255478 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="e9c1314e-efb7-422f-8107-07966ce31024" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:28.257530 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.257496 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jnzgx\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:28.320082 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.320043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp8w2\" (UniqueName: \"kubernetes.io/projected/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-kube-api-access-wp8w2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q55wv\" (UID: \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:28.320294 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.320106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q55wv\" (UID: \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:28.417465 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.417440 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:28.420532 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.420501 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="e9c1314e-efb7-422f-8107-07966ce31024" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:28.420766 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.420747 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xxs9\" (UniqueName: \"kubernetes.io/projected/47977d54-dc21-4fb3-b463-cab1186eac59-kube-api-access-4xxs9\") pod \"limitador-operator-controller-manager-859d7b78bd-v4v4c\" (UID: \"47977d54-dc21-4fb3-b463-cab1186eac59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" Jul 24 03:26:28.420846 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.420827 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:28.420905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.420870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp8w2\" (UniqueName: \"kubernetes.io/projected/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-kube-api-access-wp8w2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q55wv\" (UID: \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:28.420962 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.420917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q55wv\" (UID: \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:28.421242 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.421221 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q55wv\" (UID: \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:28.422752 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.422724 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jnzgx\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:28.426387 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.426361 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-g79vb\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="e9c1314e-efb7-422f-8107-07966ce31024" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:28.430091 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:28.430057 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jnzgx\" is forbidden: User \"system:node:ip-10-0-142-95.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-95.ec2.internal' and this object" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:28.444133 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.444104 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp8w2\" (UniqueName: \"kubernetes.io/projected/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-kube-api-access-wp8w2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q55wv\" (UID: \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:28.521885 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.521853 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9c1314e-efb7-422f-8107-07966ce31024-extensions-socket-volume\") pod \"e9c1314e-efb7-422f-8107-07966ce31024\" (UID: \"e9c1314e-efb7-422f-8107-07966ce31024\") " Jul 24 03:26:28.522081 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.521933 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9295r\" (UniqueName: \"kubernetes.io/projected/a442a629-97b6-43c0-921e-6596f22bc4b1-kube-api-access-9295r\") pod \"a442a629-97b6-43c0-921e-6596f22bc4b1\" (UID: \"a442a629-97b6-43c0-921e-6596f22bc4b1\") " Jul 24 03:26:28.522081 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.521981 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlxtk\" (UniqueName: \"kubernetes.io/projected/e9c1314e-efb7-422f-8107-07966ce31024-kube-api-access-vlxtk\") pod \"e9c1314e-efb7-422f-8107-07966ce31024\" (UID: \"e9c1314e-efb7-422f-8107-07966ce31024\") " Jul 24 03:26:28.522251 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.522114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xxs9\" (UniqueName: \"kubernetes.io/projected/47977d54-dc21-4fb3-b463-cab1186eac59-kube-api-access-4xxs9\") pod \"limitador-operator-controller-manager-859d7b78bd-v4v4c\" (UID: \"47977d54-dc21-4fb3-b463-cab1186eac59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" Jul 24 03:26:28.522495 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.522466 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9c1314e-efb7-422f-8107-07966ce31024-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e9c1314e-efb7-422f-8107-07966ce31024" (UID: "e9c1314e-efb7-422f-8107-07966ce31024"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:26:28.524398 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.524377 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9c1314e-efb7-422f-8107-07966ce31024-kube-api-access-vlxtk" (OuterVolumeSpecName: "kube-api-access-vlxtk") pod "e9c1314e-efb7-422f-8107-07966ce31024" (UID: "e9c1314e-efb7-422f-8107-07966ce31024"). InnerVolumeSpecName "kube-api-access-vlxtk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:26:28.524448 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.524410 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a442a629-97b6-43c0-921e-6596f22bc4b1-kube-api-access-9295r" (OuterVolumeSpecName: "kube-api-access-9295r") pod "a442a629-97b6-43c0-921e-6596f22bc4b1" (UID: "a442a629-97b6-43c0-921e-6596f22bc4b1"). InnerVolumeSpecName "kube-api-access-9295r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:26:28.535482 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.535449 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xxs9\" (UniqueName: \"kubernetes.io/projected/47977d54-dc21-4fb3-b463-cab1186eac59-kube-api-access-4xxs9\") pod \"limitador-operator-controller-manager-859d7b78bd-v4v4c\" (UID: \"47977d54-dc21-4fb3-b463-cab1186eac59\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" Jul 24 03:26:28.568425 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.568394 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:28.575164 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.575140 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" Jul 24 03:26:28.623692 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.623657 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9295r\" (UniqueName: \"kubernetes.io/projected/a442a629-97b6-43c0-921e-6596f22bc4b1-kube-api-access-9295r\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:26:28.623692 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.623695 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlxtk\" (UniqueName: \"kubernetes.io/projected/e9c1314e-efb7-422f-8107-07966ce31024-kube-api-access-vlxtk\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:26:28.623878 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.623710 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e9c1314e-efb7-422f-8107-07966ce31024-extensions-socket-volume\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:26:28.732923 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.732897 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv"] Jul 24 03:26:28.734933 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:26:28.734908 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116a9ec7_752d_469a_b3f9_8dcdcbc1d0a3.slice/crio-0b84f490aabd2c2b9f9c96a3d09a0238fe834e2ee83132ace92e5ffeaf78431b WatchSource:0}: Error finding container 0b84f490aabd2c2b9f9c96a3d09a0238fe834e2ee83132ace92e5ffeaf78431b: Status 404 returned error can't find the container with id 0b84f490aabd2c2b9f9c96a3d09a0238fe834e2ee83132ace92e5ffeaf78431b Jul 24 03:26:28.763118 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.763093 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c"] Jul 24 03:26:28.765339 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:26:28.765312 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47977d54_dc21_4fb3_b463_cab1186eac59.slice/crio-302436b53673a3f44aeab6782f59ac9b257f55aba82db3da5aa1caa76ca1adaf WatchSource:0}: Error finding container 302436b53673a3f44aeab6782f59ac9b257f55aba82db3da5aa1caa76ca1adaf: Status 404 returned error can't find the container with id 302436b53673a3f44aeab6782f59ac9b257f55aba82db3da5aa1caa76ca1adaf Jul 24 03:26:28.907153 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.907113 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a442a629-97b6-43c0-921e-6596f22bc4b1" path="/var/lib/kubelet/pods/a442a629-97b6-43c0-921e-6596f22bc4b1/volumes" Jul 24 03:26:28.907541 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:28.907522 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9c1314e-efb7-422f-8107-07966ce31024" path="/var/lib/kubelet/pods/e9c1314e-efb7-422f-8107-07966ce31024/volumes" Jul 24 03:26:29.249808 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.249773 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" event={"ID":"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3","Type":"ContainerStarted","Data":"ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8"} Jul 24 03:26:29.250319 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.249829 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" event={"ID":"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3","Type":"ContainerStarted","Data":"0b84f490aabd2c2b9f9c96a3d09a0238fe834e2ee83132ace92e5ffeaf78431b"} Jul 24 03:26:29.250319 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.249889 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:29.251216 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.251187 2559 generic.go:356] "Generic (PLEG): container finished" podID="a442a629-97b6-43c0-921e-6596f22bc4b1" containerID="194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584" exitCode=0 Jul 24 03:26:29.251365 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.251232 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jnzgx" Jul 24 03:26:29.251365 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.251312 2559 scope.go:117] "RemoveContainer" containerID="194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584" Jul 24 03:26:29.252866 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.252842 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" event={"ID":"47977d54-dc21-4fb3-b463-cab1186eac59","Type":"ContainerStarted","Data":"841579c2a6f6aed7bff643f54105b70cd9a1dfc372bed9821e2bd162dbc2aa80"} Jul 24 03:26:29.252975 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.252892 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" event={"ID":"47977d54-dc21-4fb3-b463-cab1186eac59","Type":"ContainerStarted","Data":"302436b53673a3f44aeab6782f59ac9b257f55aba82db3da5aa1caa76ca1adaf"} Jul 24 03:26:29.253036 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.253010 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" Jul 24 03:26:29.254465 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.254442 2559 generic.go:356] "Generic (PLEG): container finished" podID="e9c1314e-efb7-422f-8107-07966ce31024" containerID="80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563" exitCode=0 Jul 24 03:26:29.254615 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.254597 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g79vb" Jul 24 03:26:29.260503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.260488 2559 scope.go:117] "RemoveContainer" containerID="194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584" Jul 24 03:26:29.260763 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:29.260742 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584\": container with ID starting with 194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584 not found: ID does not exist" containerID="194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584" Jul 24 03:26:29.260803 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.260770 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584"} err="failed to get container status \"194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584\": rpc error: code = NotFound desc = could not find container \"194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584\": container with ID starting with 194a1f72e3f71be1baaaf98daff5c0c3724c37a6c6614ba67243510a9289a584 not found: ID does not exist" Jul 24 03:26:29.260803 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.260797 2559 scope.go:117] "RemoveContainer" containerID="80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563" Jul 24 03:26:29.268531 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.268515 2559 scope.go:117] "RemoveContainer" containerID="80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563" Jul 24 03:26:29.268779 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:29.268762 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563\": container with ID starting with 80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563 not found: ID does not exist" containerID="80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563" Jul 24 03:26:29.268848 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.268787 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563"} err="failed to get container status \"80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563\": rpc error: code = NotFound desc = could not find container \"80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563\": container with ID starting with 80bf034bfd3676a026c2e27cc9db7ec0dc2544d90d6043ee997b302b0502f563 not found: ID does not exist" Jul 24 03:26:29.294315 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.294246 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" podStartSLOduration=1.294230938 podStartE2EDuration="1.294230938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:26:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:26:29.291042589 +0000 UTC m=+512.865692524" watchObservedRunningTime="2026-07-24 03:26:29.294230938 +0000 UTC m=+512.868880871" Jul 24 03:26:29.339052 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:29.338996 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" podStartSLOduration=1.338977398 podStartE2EDuration="1.338977398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:26:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:26:29.330492244 +0000 UTC m=+512.905142173" watchObservedRunningTime="2026-07-24 03:26:29.338977398 +0000 UTC m=+512.913627330" Jul 24 03:26:40.263438 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:40.263403 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-v4v4c" Jul 24 03:26:40.263845 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:40.263483 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:55.965724 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:55.965642 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv"] Jul 24 03:26:55.966090 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:55.965871 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" podUID="116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3" containerName="manager" containerID="cri-o://ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8" gracePeriod=10 Jul 24 03:26:56.215530 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.215505 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:56.270329 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.270263 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-extensions-socket-volume\") pod \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\" (UID: \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\") " Jul 24 03:26:56.270515 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.270364 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp8w2\" (UniqueName: \"kubernetes.io/projected/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-kube-api-access-wp8w2\") pod \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\" (UID: \"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3\") " Jul 24 03:26:56.270624 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.270600 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3" (UID: "116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:26:56.272494 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.272468 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-kube-api-access-wp8w2" (OuterVolumeSpecName: "kube-api-access-wp8w2") pod "116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3" (UID: "116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3"). InnerVolumeSpecName "kube-api-access-wp8w2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:26:56.371298 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.371229 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-extensions-socket-volume\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:26:56.371298 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.371272 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp8w2\" (UniqueName: \"kubernetes.io/projected/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3-kube-api-access-wp8w2\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:26:56.387702 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.387667 2559 generic.go:356] "Generic (PLEG): container finished" podID="116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3" containerID="ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8" exitCode=0 Jul 24 03:26:56.387851 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.387712 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" Jul 24 03:26:56.387851 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.387732 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" event={"ID":"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3","Type":"ContainerDied","Data":"ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8"} Jul 24 03:26:56.387851 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.387787 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv" event={"ID":"116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3","Type":"ContainerDied","Data":"0b84f490aabd2c2b9f9c96a3d09a0238fe834e2ee83132ace92e5ffeaf78431b"} Jul 24 03:26:56.387851 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.387817 2559 scope.go:117] "RemoveContainer" containerID="ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8" Jul 24 03:26:56.397613 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.397598 2559 scope.go:117] "RemoveContainer" containerID="ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8" Jul 24 03:26:56.398226 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:26:56.398141 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8\": container with ID starting with ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8 not found: ID does not exist" containerID="ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8" Jul 24 03:26:56.398226 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.398186 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8"} err="failed to get container status \"ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8\": rpc error: code = NotFound desc = could not find container \"ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8\": container with ID starting with ee1749d4f5b0a3c7f873a8adabcac11e1390b446baed29a61ff4537337314bd8 not found: ID does not exist" Jul 24 03:26:56.410566 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.410544 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv"] Jul 24 03:26:56.414439 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.414417 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q55wv"] Jul 24 03:26:56.905261 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:26:56.905230 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3" path="/var/lib/kubelet/pods/116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3/volumes" Jul 24 03:27:12.317398 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.317367 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs"] Jul 24 03:27:12.317959 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.317914 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3" containerName="manager" Jul 24 03:27:12.317959 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.317933 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3" containerName="manager" Jul 24 03:27:12.318075 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.318028 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="116a9ec7-752d-469a-b3f9-8dcdcbc1d0a3" containerName="manager" Jul 24 03:27:12.322563 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.322542 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.325134 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.325113 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 03:27:12.325261 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.325115 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sgbqk\"" Jul 24 03:27:12.330331 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.330307 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs"] Jul 24 03:27:12.409601 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409570 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fld4\" (UniqueName: \"kubernetes.io/projected/5294ee2d-0568-4328-9715-dda3cfc0b778-kube-api-access-4fld4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.409601 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.409827 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5294ee2d-0568-4328-9715-dda3cfc0b778-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.409827 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.409827 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409778 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.409940 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.409940 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409889 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.409940 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.410042 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.409948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510463 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510648 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510648 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510648 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510522 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510648 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510648 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fld4\" (UniqueName: \"kubernetes.io/projected/5294ee2d-0568-4328-9715-dda3cfc0b778-kube-api-access-4fld4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510648 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510577 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510925 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510791 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5294ee2d-0568-4328-9715-dda3cfc0b778-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.510925 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510869 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.511030 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.510964 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.511137 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.511116 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.511195 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.511178 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.511332 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.511311 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.511750 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.511726 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5294ee2d-0568-4328-9715-dda3cfc0b778-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.513021 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.512999 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.513205 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.513188 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.519242 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.519213 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5294ee2d-0568-4328-9715-dda3cfc0b778-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.519364 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.519348 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fld4\" (UniqueName: \"kubernetes.io/projected/5294ee2d-0568-4328-9715-dda3cfc0b778-kube-api-access-4fld4\") pod \"maas-default-gateway-openshift-default-78bb78ff78-d24gs\" (UID: \"5294ee2d-0568-4328-9715-dda3cfc0b778\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.635679 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.635587 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:12.777854 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:12.777825 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs"] Jul 24 03:27:12.780524 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:27:12.780499 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5294ee2d_0568_4328_9715_dda3cfc0b778.slice/crio-b851882baf7b00d0fe44d56bba84fb9a744ee5e0f204caf2bcf0d0cfde88efa4 WatchSource:0}: Error finding container b851882baf7b00d0fe44d56bba84fb9a744ee5e0f204caf2bcf0d0cfde88efa4: Status 404 returned error can't find the container with id b851882baf7b00d0fe44d56bba84fb9a744ee5e0f204caf2bcf0d0cfde88efa4 Jul 24 03:27:13.477823 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:13.477789 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" event={"ID":"5294ee2d-0568-4328-9715-dda3cfc0b778","Type":"ContainerStarted","Data":"b851882baf7b00d0fe44d56bba84fb9a744ee5e0f204caf2bcf0d0cfde88efa4"} Jul 24 03:27:15.468151 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:15.468117 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 24 03:27:15.468546 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:15.468196 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 24 03:27:15.468546 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:15.468244 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 24 03:27:16.493431 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:16.493398 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" event={"ID":"5294ee2d-0568-4328-9715-dda3cfc0b778","Type":"ContainerStarted","Data":"69f572290e50f8205138deeb0756ab4d19a7df5ba80492f3f8a09f7868b85980"} Jul 24 03:27:16.514893 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:16.514842 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" podStartSLOduration=1.8298193139999999 podStartE2EDuration="4.514826341s" totalImagesPullingTime="2.685007027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:27:16.514268629 +0000 UTC m=+560.088918615" watchObservedRunningTime="2026-07-24 03:27:16.514826341 +0000 UTC m=+560.089476272" Jul 24 03:27:16.636145 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:16.636113 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:16.641451 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:16.641422 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:17.478978 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.478944 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xww4h"] Jul 24 03:27:17.482253 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.482237 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:17.484567 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.484547 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 24 03:27:17.484699 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.484652 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9t75r\"" Jul 24 03:27:17.490115 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.490095 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xww4h"] Jul 24 03:27:17.497782 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.497759 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:17.498842 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.498822 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:27:17.577503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.577474 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xww4h"] Jul 24 03:27:17.658066 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.658033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrcpg\" (UniqueName: \"kubernetes.io/projected/3ac38f41-f013-41bb-9613-67b1d936ef52-kube-api-access-wrcpg\") pod \"limitador-limitador-64c94fd64f-xww4h\" (UID: \"3ac38f41-f013-41bb-9613-67b1d936ef52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:17.658240 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.658132 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3ac38f41-f013-41bb-9613-67b1d936ef52-config-file\") pod \"limitador-limitador-64c94fd64f-xww4h\" (UID: \"3ac38f41-f013-41bb-9613-67b1d936ef52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:17.739238 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.739162 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:27:17.742941 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.742919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:17.750223 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.750108 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:27:17.759084 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.759061 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3ac38f41-f013-41bb-9613-67b1d936ef52-config-file\") pod \"limitador-limitador-64c94fd64f-xww4h\" (UID: \"3ac38f41-f013-41bb-9613-67b1d936ef52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:17.759206 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.759119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrcpg\" (UniqueName: \"kubernetes.io/projected/3ac38f41-f013-41bb-9613-67b1d936ef52-kube-api-access-wrcpg\") pod \"limitador-limitador-64c94fd64f-xww4h\" (UID: \"3ac38f41-f013-41bb-9613-67b1d936ef52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:17.759724 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.759707 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3ac38f41-f013-41bb-9613-67b1d936ef52-config-file\") pod \"limitador-limitador-64c94fd64f-xww4h\" (UID: \"3ac38f41-f013-41bb-9613-67b1d936ef52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:17.767102 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.767074 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrcpg\" (UniqueName: \"kubernetes.io/projected/3ac38f41-f013-41bb-9613-67b1d936ef52-kube-api-access-wrcpg\") pod \"limitador-limitador-64c94fd64f-xww4h\" (UID: \"3ac38f41-f013-41bb-9613-67b1d936ef52\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:17.781062 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.781034 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:27:17.793103 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.793074 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:17.860473 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.860443 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/37516ab4-fee1-4338-b5f1-3d072190237b-config-file\") pod \"limitador-limitador-54d6d988d5-k96br\" (UID: \"37516ab4-fee1-4338-b5f1-3d072190237b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:17.860596 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.860502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7b9x\" (UniqueName: \"kubernetes.io/projected/37516ab4-fee1-4338-b5f1-3d072190237b-kube-api-access-x7b9x\") pod \"limitador-limitador-54d6d988d5-k96br\" (UID: \"37516ab4-fee1-4338-b5f1-3d072190237b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:17.925567 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.925543 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xww4h"] Jul 24 03:27:17.927317 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:27:17.927289 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac38f41_f013_41bb_9613_67b1d936ef52.slice/crio-23abbac36ac7ec947d987bd55b262a57b7ea88c57d4a6b6bffc51697d0644f56 WatchSource:0}: Error finding container 23abbac36ac7ec947d987bd55b262a57b7ea88c57d4a6b6bffc51697d0644f56: Status 404 returned error can't find the container with id 23abbac36ac7ec947d987bd55b262a57b7ea88c57d4a6b6bffc51697d0644f56 Jul 24 03:27:17.961199 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.961169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7b9x\" (UniqueName: \"kubernetes.io/projected/37516ab4-fee1-4338-b5f1-3d072190237b-kube-api-access-x7b9x\") pod \"limitador-limitador-54d6d988d5-k96br\" (UID: \"37516ab4-fee1-4338-b5f1-3d072190237b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:17.961392 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.961247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/37516ab4-fee1-4338-b5f1-3d072190237b-config-file\") pod \"limitador-limitador-54d6d988d5-k96br\" (UID: \"37516ab4-fee1-4338-b5f1-3d072190237b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:17.961860 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.961841 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/37516ab4-fee1-4338-b5f1-3d072190237b-config-file\") pod \"limitador-limitador-54d6d988d5-k96br\" (UID: \"37516ab4-fee1-4338-b5f1-3d072190237b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:17.973528 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:17.973505 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7b9x\" (UniqueName: \"kubernetes.io/projected/37516ab4-fee1-4338-b5f1-3d072190237b-kube-api-access-x7b9x\") pod \"limitador-limitador-54d6d988d5-k96br\" (UID: \"37516ab4-fee1-4338-b5f1-3d072190237b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:18.054527 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.054432 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:18.198048 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.198020 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:27:18.199930 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:27:18.199908 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37516ab4_fee1_4338_b5f1_3d072190237b.slice/crio-a678e733cce07ef8f944811a53573ae88ae73cc29ed29a3dfb3e27b5639df17c WatchSource:0}: Error finding container a678e733cce07ef8f944811a53573ae88ae73cc29ed29a3dfb3e27b5639df17c: Status 404 returned error can't find the container with id a678e733cce07ef8f944811a53573ae88ae73cc29ed29a3dfb3e27b5639df17c Jul 24 03:27:18.379251 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.379162 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqgm"] Jul 24 03:27:18.383963 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.383937 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ktqgm" Jul 24 03:27:18.386341 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.386318 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jdbv2\"" Jul 24 03:27:18.392476 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.392456 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqgm"] Jul 24 03:27:18.503245 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.503214 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" event={"ID":"37516ab4-fee1-4338-b5f1-3d072190237b","Type":"ContainerStarted","Data":"a678e733cce07ef8f944811a53573ae88ae73cc29ed29a3dfb3e27b5639df17c"} Jul 24 03:27:18.504459 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.504433 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" event={"ID":"3ac38f41-f013-41bb-9613-67b1d936ef52","Type":"ContainerStarted","Data":"23abbac36ac7ec947d987bd55b262a57b7ea88c57d4a6b6bffc51697d0644f56"} Jul 24 03:27:18.565409 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.565369 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57k44\" (UniqueName: \"kubernetes.io/projected/1083c150-d5dd-42cf-8dda-0be763e1a23b-kube-api-access-57k44\") pod \"authorino-75d556bd77-ktqgm\" (UID: \"1083c150-d5dd-42cf-8dda-0be763e1a23b\") " pod="kuadrant-system/authorino-75d556bd77-ktqgm" Jul 24 03:27:18.666794 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.666415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57k44\" (UniqueName: \"kubernetes.io/projected/1083c150-d5dd-42cf-8dda-0be763e1a23b-kube-api-access-57k44\") pod \"authorino-75d556bd77-ktqgm\" (UID: \"1083c150-d5dd-42cf-8dda-0be763e1a23b\") " pod="kuadrant-system/authorino-75d556bd77-ktqgm" Jul 24 03:27:18.675798 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.675767 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57k44\" (UniqueName: \"kubernetes.io/projected/1083c150-d5dd-42cf-8dda-0be763e1a23b-kube-api-access-57k44\") pod \"authorino-75d556bd77-ktqgm\" (UID: \"1083c150-d5dd-42cf-8dda-0be763e1a23b\") " pod="kuadrant-system/authorino-75d556bd77-ktqgm" Jul 24 03:27:18.695074 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.695038 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ktqgm" Jul 24 03:27:18.883378 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:18.883340 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqgm"] Jul 24 03:27:19.514582 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:19.514150 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ktqgm" event={"ID":"1083c150-d5dd-42cf-8dda-0be763e1a23b","Type":"ContainerStarted","Data":"d2aa14aee9bdd4bd35aa28f3fb9e35758106fdc00e1b4a8bef5c01c34e142eda"} Jul 24 03:27:23.536216 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:23.536180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" event={"ID":"37516ab4-fee1-4338-b5f1-3d072190237b","Type":"ContainerStarted","Data":"b5827d3786b89e852824afb39ff8f9565d96f6b8e158e8d646d4dd4c67cef620"} Jul 24 03:27:23.536701 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:23.536306 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:23.537768 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:23.537739 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ktqgm" event={"ID":"1083c150-d5dd-42cf-8dda-0be763e1a23b","Type":"ContainerStarted","Data":"3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b"} Jul 24 03:27:23.539227 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:23.539206 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" event={"ID":"3ac38f41-f013-41bb-9613-67b1d936ef52","Type":"ContainerStarted","Data":"731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0"} Jul 24 03:27:23.539349 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:23.539249 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:23.554127 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:23.554085 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" podStartSLOduration=1.779792421 podStartE2EDuration="6.55407159s" totalImagesPullingTime="4.774279169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:27:23.553195027 +0000 UTC m=+567.127844956" watchObservedRunningTime="2026-07-24 03:27:23.55407159 +0000 UTC m=+567.128721521" Jul 24 03:27:23.571233 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:23.571184 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" podStartSLOduration=1.517203911 podStartE2EDuration="6.57116991s" totalImagesPullingTime="5.053965999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:27:23.569655815 +0000 UTC m=+567.144305747" watchObservedRunningTime="2026-07-24 03:27:23.57116991 +0000 UTC m=+567.145819842" Jul 24 03:27:23.583644 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:23.583596 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ktqgm" podStartSLOduration=1.493385276 podStartE2EDuration="5.583581395s" totalImagesPullingTime="4.090196119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:27:23.582578021 +0000 UTC m=+567.157227953" watchObservedRunningTime="2026-07-24 03:27:23.583581395 +0000 UTC m=+567.158231328" Jul 24 03:27:34.545100 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:34.545065 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-k96br" Jul 24 03:27:34.546490 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:34.546473 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:34.614129 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:34.614094 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xww4h"] Jul 24 03:27:34.614394 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:34.614353 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" podUID="3ac38f41-f013-41bb-9613-67b1d936ef52" containerName="limitador" containerID="cri-o://731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0" gracePeriod=30 Jul 24 03:27:35.162874 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.162848 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:35.205026 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.204920 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrcpg\" (UniqueName: \"kubernetes.io/projected/3ac38f41-f013-41bb-9613-67b1d936ef52-kube-api-access-wrcpg\") pod \"3ac38f41-f013-41bb-9613-67b1d936ef52\" (UID: \"3ac38f41-f013-41bb-9613-67b1d936ef52\") " Jul 24 03:27:35.205026 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.204986 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3ac38f41-f013-41bb-9613-67b1d936ef52-config-file\") pod \"3ac38f41-f013-41bb-9613-67b1d936ef52\" (UID: \"3ac38f41-f013-41bb-9613-67b1d936ef52\") " Jul 24 03:27:35.205382 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.205359 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ac38f41-f013-41bb-9613-67b1d936ef52-config-file" (OuterVolumeSpecName: "config-file") pod "3ac38f41-f013-41bb-9613-67b1d936ef52" (UID: "3ac38f41-f013-41bb-9613-67b1d936ef52"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 03:27:35.207375 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.207343 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ac38f41-f013-41bb-9613-67b1d936ef52-kube-api-access-wrcpg" (OuterVolumeSpecName: "kube-api-access-wrcpg") pod "3ac38f41-f013-41bb-9613-67b1d936ef52" (UID: "3ac38f41-f013-41bb-9613-67b1d936ef52"). InnerVolumeSpecName "kube-api-access-wrcpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:27:35.306254 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.306218 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrcpg\" (UniqueName: \"kubernetes.io/projected/3ac38f41-f013-41bb-9613-67b1d936ef52-kube-api-access-wrcpg\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:27:35.306254 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.306247 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3ac38f41-f013-41bb-9613-67b1d936ef52-config-file\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:27:35.598723 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.598692 2559 generic.go:356] "Generic (PLEG): container finished" podID="3ac38f41-f013-41bb-9613-67b1d936ef52" containerID="731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0" exitCode=0 Jul 24 03:27:35.599093 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.598734 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" event={"ID":"3ac38f41-f013-41bb-9613-67b1d936ef52","Type":"ContainerDied","Data":"731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0"} Jul 24 03:27:35.599093 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.598737 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" Jul 24 03:27:35.599093 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.598776 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xww4h" event={"ID":"3ac38f41-f013-41bb-9613-67b1d936ef52","Type":"ContainerDied","Data":"23abbac36ac7ec947d987bd55b262a57b7ea88c57d4a6b6bffc51697d0644f56"} Jul 24 03:27:35.599093 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.598796 2559 scope.go:117] "RemoveContainer" containerID="731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0" Jul 24 03:27:35.608016 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.607999 2559 scope.go:117] "RemoveContainer" containerID="731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0" Jul 24 03:27:35.608321 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:27:35.608269 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0\": container with ID starting with 731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0 not found: ID does not exist" containerID="731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0" Jul 24 03:27:35.608392 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.608335 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0"} err="failed to get container status \"731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0\": rpc error: code = NotFound desc = could not find container \"731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0\": container with ID starting with 731c006f1b5c14b17e3999976ffef6838eaac96129cb950cac0dff1f5f116db0 not found: ID does not exist" Jul 24 03:27:35.619469 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.619447 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xww4h"] Jul 24 03:27:35.623310 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:35.623271 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xww4h"] Jul 24 03:27:36.906097 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:36.906065 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ac38f41-f013-41bb-9613-67b1d936ef52" path="/var/lib/kubelet/pods/3ac38f41-f013-41bb-9613-67b1d936ef52/volumes" Jul 24 03:27:39.145168 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.145137 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-scwqw"] Jul 24 03:27:39.145759 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.145739 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac38f41-f013-41bb-9613-67b1d936ef52" containerName="limitador" Jul 24 03:27:39.145801 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.145764 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac38f41-f013-41bb-9613-67b1d936ef52" containerName="limitador" Jul 24 03:27:39.145901 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.145889 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ac38f41-f013-41bb-9613-67b1d936ef52" containerName="limitador" Jul 24 03:27:39.150789 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.150764 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:39.153221 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.153198 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 24 03:27:39.154331 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.154189 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 03:27:39.154331 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.154214 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rclzv\"" Jul 24 03:27:39.154331 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.154247 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 24 03:27:39.157441 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.157379 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-scwqw"] Jul 24 03:27:39.245033 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.244998 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szxnn\" (UniqueName: \"kubernetes.io/projected/891ced35-6317-4d39-901a-ee6e07882f1a-kube-api-access-szxnn\") pod \"postgres-69fb4594cf-scwqw\" (UID: \"891ced35-6317-4d39-901a-ee6e07882f1a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:39.245200 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.245041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/891ced35-6317-4d39-901a-ee6e07882f1a-data\") pod \"postgres-69fb4594cf-scwqw\" (UID: \"891ced35-6317-4d39-901a-ee6e07882f1a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:39.346023 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.345988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szxnn\" (UniqueName: \"kubernetes.io/projected/891ced35-6317-4d39-901a-ee6e07882f1a-kube-api-access-szxnn\") pod \"postgres-69fb4594cf-scwqw\" (UID: \"891ced35-6317-4d39-901a-ee6e07882f1a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:39.346213 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.346042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/891ced35-6317-4d39-901a-ee6e07882f1a-data\") pod \"postgres-69fb4594cf-scwqw\" (UID: \"891ced35-6317-4d39-901a-ee6e07882f1a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:39.346539 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.346522 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/891ced35-6317-4d39-901a-ee6e07882f1a-data\") pod \"postgres-69fb4594cf-scwqw\" (UID: \"891ced35-6317-4d39-901a-ee6e07882f1a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:39.354460 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.354430 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szxnn\" (UniqueName: \"kubernetes.io/projected/891ced35-6317-4d39-901a-ee6e07882f1a-kube-api-access-szxnn\") pod \"postgres-69fb4594cf-scwqw\" (UID: \"891ced35-6317-4d39-901a-ee6e07882f1a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:39.463672 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.463582 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:39.599578 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.599556 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-scwqw"] Jul 24 03:27:39.601612 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:27:39.601582 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891ced35_6317_4d39_901a_ee6e07882f1a.slice/crio-3eb84b8fe94e85eda941ae30ab8814b1de74ca060aa4ebff7f8883acd5fd10cf WatchSource:0}: Error finding container 3eb84b8fe94e85eda941ae30ab8814b1de74ca060aa4ebff7f8883acd5fd10cf: Status 404 returned error can't find the container with id 3eb84b8fe94e85eda941ae30ab8814b1de74ca060aa4ebff7f8883acd5fd10cf Jul 24 03:27:39.619644 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:39.619617 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" event={"ID":"891ced35-6317-4d39-901a-ee6e07882f1a","Type":"ContainerStarted","Data":"3eb84b8fe94e85eda941ae30ab8814b1de74ca060aa4ebff7f8883acd5fd10cf"} Jul 24 03:27:44.652644 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:44.652607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" event={"ID":"891ced35-6317-4d39-901a-ee6e07882f1a","Type":"ContainerStarted","Data":"8dd507f176e9dcb755d6f35e643c923c7a0c29d93e7219cf3c549c0fda5cc308"} Jul 24 03:27:44.653038 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:44.652711 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:44.672338 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:44.672224 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" podStartSLOduration=0.855206909 podStartE2EDuration="5.672208565s" totalImagesPullingTime="4.817001656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:27:44.670347843 +0000 UTC m=+588.244997790" watchObservedRunningTime="2026-07-24 03:27:44.672208565 +0000 UTC m=+588.246858497" Jul 24 03:27:50.686411 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:50.686384 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-scwqw" Jul 24 03:27:51.214616 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.214574 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9n9gf"] Jul 24 03:27:51.218077 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.218051 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9n9gf" Jul 24 03:27:51.222087 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.222060 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9n9gf"] Jul 24 03:27:51.358515 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.358482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grvx9\" (UniqueName: \"kubernetes.io/projected/2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc-kube-api-access-grvx9\") pod \"authorino-5d4b67c446-9n9gf\" (UID: \"2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc\") " pod="kuadrant-system/authorino-5d4b67c446-9n9gf" Jul 24 03:27:51.423859 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.423819 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9n9gf"] Jul 24 03:27:51.424151 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:27:51.424127 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-grvx9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-9n9gf" podUID="2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc" Jul 24 03:27:51.459063 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.459025 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grvx9\" (UniqueName: \"kubernetes.io/projected/2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc-kube-api-access-grvx9\") pod \"authorino-5d4b67c446-9n9gf\" (UID: \"2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc\") " pod="kuadrant-system/authorino-5d4b67c446-9n9gf" Jul 24 03:27:51.467461 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.467397 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grvx9\" (UniqueName: \"kubernetes.io/projected/2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc-kube-api-access-grvx9\") pod \"authorino-5d4b67c446-9n9gf\" (UID: \"2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc\") " pod="kuadrant-system/authorino-5d4b67c446-9n9gf" Jul 24 03:27:51.683981 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.683953 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9n9gf" Jul 24 03:27:51.691107 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.691084 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9n9gf" Jul 24 03:27:51.761420 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.761386 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grvx9\" (UniqueName: \"kubernetes.io/projected/2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc-kube-api-access-grvx9\") pod \"2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc\" (UID: \"2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc\") " Jul 24 03:27:51.763698 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.763676 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc-kube-api-access-grvx9" (OuterVolumeSpecName: "kube-api-access-grvx9") pod "2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc" (UID: "2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc"). InnerVolumeSpecName "kube-api-access-grvx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:27:51.862391 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:51.862357 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grvx9\" (UniqueName: \"kubernetes.io/projected/2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc-kube-api-access-grvx9\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:27:52.688967 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:52.688937 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9n9gf" Jul 24 03:27:52.717486 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:52.717455 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9n9gf"] Jul 24 03:27:52.721063 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:52.721038 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9n9gf"] Jul 24 03:27:52.906213 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:52.906178 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc" path="/var/lib/kubelet/pods/2be39cfc-0ada-4d2c-ac19-4ab3fe5e59cc/volumes" Jul 24 03:27:53.243152 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.243123 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqgm"] Jul 24 03:27:53.243394 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.243370 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ktqgm" podUID="1083c150-d5dd-42cf-8dda-0be763e1a23b" containerName="authorino" containerID="cri-o://3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b" gracePeriod=30 Jul 24 03:27:53.495780 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.495716 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ktqgm" Jul 24 03:27:53.577815 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.577780 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57k44\" (UniqueName: \"kubernetes.io/projected/1083c150-d5dd-42cf-8dda-0be763e1a23b-kube-api-access-57k44\") pod \"1083c150-d5dd-42cf-8dda-0be763e1a23b\" (UID: \"1083c150-d5dd-42cf-8dda-0be763e1a23b\") " Jul 24 03:27:53.579972 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.579945 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1083c150-d5dd-42cf-8dda-0be763e1a23b-kube-api-access-57k44" (OuterVolumeSpecName: "kube-api-access-57k44") pod "1083c150-d5dd-42cf-8dda-0be763e1a23b" (UID: "1083c150-d5dd-42cf-8dda-0be763e1a23b"). InnerVolumeSpecName "kube-api-access-57k44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:27:53.679234 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.679189 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57k44\" (UniqueName: \"kubernetes.io/projected/1083c150-d5dd-42cf-8dda-0be763e1a23b-kube-api-access-57k44\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:27:53.695143 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.695111 2559 generic.go:356] "Generic (PLEG): container finished" podID="1083c150-d5dd-42cf-8dda-0be763e1a23b" containerID="3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b" exitCode=0 Jul 24 03:27:53.695317 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.695155 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ktqgm" Jul 24 03:27:53.695317 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.695187 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ktqgm" event={"ID":"1083c150-d5dd-42cf-8dda-0be763e1a23b","Type":"ContainerDied","Data":"3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b"} Jul 24 03:27:53.695317 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.695219 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ktqgm" event={"ID":"1083c150-d5dd-42cf-8dda-0be763e1a23b","Type":"ContainerDied","Data":"d2aa14aee9bdd4bd35aa28f3fb9e35758106fdc00e1b4a8bef5c01c34e142eda"} Jul 24 03:27:53.695317 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.695235 2559 scope.go:117] "RemoveContainer" containerID="3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b" Jul 24 03:27:53.704081 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.704057 2559 scope.go:117] "RemoveContainer" containerID="3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b" Jul 24 03:27:53.704377 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:27:53.704353 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b\": container with ID starting with 3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b not found: ID does not exist" containerID="3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b" Jul 24 03:27:53.704439 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.704391 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b"} err="failed to get container status \"3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b\": rpc error: code = NotFound desc = could not find container \"3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b\": container with ID starting with 3548ccb5fafca4e1e8da49ce9bfec91615304d883e2c43cca7022c4e1df1de1b not found: ID does not exist" Jul 24 03:27:53.715254 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.715233 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqgm"] Jul 24 03:27:53.718811 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:53.718788 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ktqgm"] Jul 24 03:27:54.906197 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:54.906169 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1083c150-d5dd-42cf-8dda-0be763e1a23b" path="/var/lib/kubelet/pods/1083c150-d5dd-42cf-8dda-0be763e1a23b/volumes" Jul 24 03:27:56.779004 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:56.778977 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:27:56.779476 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:56.778995 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:27:56.787134 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:56.787106 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:27:56.787634 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:27:56.787618 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:28:37.364826 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:37.364788 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:28:45.954049 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:45.954013 2559 generic.go:356] "Generic (PLEG): container finished" podID="5294ee2d-0568-4328-9715-dda3cfc0b778" containerID="69f572290e50f8205138deeb0756ab4d19a7df5ba80492f3f8a09f7868b85980" exitCode=0 Jul 24 03:28:45.954489 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:45.954087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" event={"ID":"5294ee2d-0568-4328-9715-dda3cfc0b778","Type":"ContainerDied","Data":"69f572290e50f8205138deeb0756ab4d19a7df5ba80492f3f8a09f7868b85980"} Jul 24 03:28:45.954489 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:45.954486 2559 scope.go:117] "RemoveContainer" containerID="69f572290e50f8205138deeb0756ab4d19a7df5ba80492f3f8a09f7868b85980" Jul 24 03:28:45.955457 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:45.955430 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 24 03:28:45.955530 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:45.955499 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 24 03:28:45.955576 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:45.955561 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 24 03:28:46.961208 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:46.961165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" event={"ID":"5294ee2d-0568-4328-9715-dda3cfc0b778","Type":"ContainerStarted","Data":"ef65fb6abe28ff9b095bcab1823afd1fb3734aed8d1d3df36058277e35f785be"} Jul 24 03:28:47.498219 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:47.498176 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:28:47.636367 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:47.636329 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:28:47.637572 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:47.637542 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-d24gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 24 03:28:47.637702 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:47.637607 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" podUID="5294ee2d-0568-4328-9715-dda3cfc0b778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 24 03:28:48.636375 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:48.636336 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-d24gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 24 03:28:48.636860 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:48.636419 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" podUID="5294ee2d-0568-4328-9715-dda3cfc0b778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 24 03:28:49.636571 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:49.636530 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-d24gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 24 03:28:49.637057 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:49.636596 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" podUID="5294ee2d-0568-4328-9715-dda3cfc0b778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 24 03:28:50.636959 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:50.636916 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-d24gs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jul 24 03:28:50.637413 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:50.637003 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" podUID="5294ee2d-0568-4328-9715-dda3cfc0b778" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jul 24 03:28:51.640642 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:51.640610 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:28:51.641770 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:28:51.641751 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-d24gs" Jul 24 03:29:06.962924 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.962888 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk"] Jul 24 03:29:06.963362 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.963333 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1083c150-d5dd-42cf-8dda-0be763e1a23b" containerName="authorino" Jul 24 03:29:06.963362 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.963347 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1083c150-d5dd-42cf-8dda-0be763e1a23b" containerName="authorino" Jul 24 03:29:06.963496 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.963482 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1083c150-d5dd-42cf-8dda-0be763e1a23b" containerName="authorino" Jul 24 03:29:06.965946 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.965920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:06.968515 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.968489 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 03:29:06.969794 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.969774 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 03:29:06.969942 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.969921 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kdtrl\"" Jul 24 03:29:06.969942 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.969925 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 24 03:29:06.975216 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:06.975192 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk"] Jul 24 03:29:07.022814 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.022777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.022984 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.022822 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwdnt\" (UniqueName: \"kubernetes.io/projected/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-kube-api-access-xwdnt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.022984 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.022855 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.022984 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.022924 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.023104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.022989 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.023104 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.023022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124013 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.123970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124198 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.124024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124198 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.124056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124198 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.124146 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwdnt\" (UniqueName: \"kubernetes.io/projected/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-kube-api-access-xwdnt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124414 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.124198 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124414 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.124259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124520 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.124504 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124633 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.124609 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.124805 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.124647 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.127034 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.127007 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.127364 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.127347 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.133091 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.133065 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwdnt\" (UniqueName: \"kubernetes.io/projected/01a27ba4-8b37-493a-90f0-a8b22d5dc1dd-kube-api-access-xwdnt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk\" (UID: \"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.278342 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.278304 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:07.416872 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.416846 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk"] Jul 24 03:29:07.419136 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:29:07.419107 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a27ba4_8b37_493a_90f0_a8b22d5dc1dd.slice/crio-965204e400926b47f643b1a49ab2bd8116c1706ac54214ef746e86079039e57b WatchSource:0}: Error finding container 965204e400926b47f643b1a49ab2bd8116c1706ac54214ef746e86079039e57b: Status 404 returned error can't find the container with id 965204e400926b47f643b1a49ab2bd8116c1706ac54214ef746e86079039e57b Jul 24 03:29:07.484070 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:07.484034 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:29:08.064206 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:08.064170 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" event={"ID":"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd","Type":"ContainerStarted","Data":"965204e400926b47f643b1a49ab2bd8116c1706ac54214ef746e86079039e57b"} Jul 24 03:29:09.070557 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:09.070525 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" event={"ID":"01a27ba4-8b37-493a-90f0-a8b22d5dc1dd","Type":"ContainerStarted","Data":"f8c85c8e1e5b60dd5697b0f6fdbf07b8c776a467e31f1feb718c1fd89c1f8973"} Jul 24 03:29:09.090907 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:09.090852 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" podStartSLOduration=2.104568183 podStartE2EDuration="3.09083466s" totalImagesPullingTime="986.266477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:29:09.088715162 +0000 UTC m=+672.663365095" watchObservedRunningTime="2026-07-24 03:29:09.09083466 +0000 UTC m=+672.665484569" Jul 24 03:29:17.278964 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:17.278926 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:17.279402 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:17.279019 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:17.291899 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:17.291874 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:18.127524 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:18.127497 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk" Jul 24 03:29:22.852586 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.852552 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q868x"] Jul 24 03:29:22.856522 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.856496 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:22.859069 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.859046 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 24 03:29:22.866610 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.866584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q868x"] Jul 24 03:29:22.966421 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.966380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:22.966646 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.966447 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:22.966646 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.966529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrjhb\" (UniqueName: \"kubernetes.io/projected/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-kube-api-access-vrjhb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:22.966646 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.966576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:22.966646 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.966604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:22.966816 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:22.966682 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068115 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068073 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068115 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068397 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068157 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068397 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrjhb\" (UniqueName: \"kubernetes.io/projected/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-kube-api-access-vrjhb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068397 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068397 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068602 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068549 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068602 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068563 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.068777 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.068743 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.070761 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.070735 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.070906 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.070886 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.076316 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.076294 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrjhb\" (UniqueName: \"kubernetes.io/projected/6bbc80fc-8c19-4fc6-996e-7e7d851b6a69-kube-api-access-vrjhb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-q868x\" (UID: \"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.168314 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.168190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:23.313648 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.309122 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-q868x"] Jul 24 03:29:23.317202 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.316822 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 03:29:23.683216 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:23.683182 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:29:24.144869 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:24.144833 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" event={"ID":"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69","Type":"ContainerStarted","Data":"3ac5f9e3521d394c9c96d22f862202c4ffc012f4b177dfa5ae2d81027ce93189"} Jul 24 03:29:24.145255 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:24.144897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" event={"ID":"6bbc80fc-8c19-4fc6-996e-7e7d851b6a69","Type":"ContainerStarted","Data":"02189d49434fb91e42409f22b848d766811091944ddf4219d212603f9614b765"} Jul 24 03:29:24.167497 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:24.167447 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" podStartSLOduration=1.990095878 podStartE2EDuration="2.167428605s" totalImagesPullingTime="177.332727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:29:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:29:24.165373353 +0000 UTC m=+687.740023309" watchObservedRunningTime="2026-07-24 03:29:24.167428605 +0000 UTC m=+687.742078536" Jul 24 03:29:33.168779 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:33.168738 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:33.169189 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:33.168806 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:33.181656 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:33.181629 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:33.201561 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:33.201527 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-q868x" Jul 24 03:29:34.097046 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:34.097005 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:29:53.085895 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:29:53.085821 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:30:00.603645 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:00.603608 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:30:08.491040 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:08.491002 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:30:57.025120 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.025087 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-845bf47cb9-2vx7r"] Jul 24 03:30:57.028679 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.028659 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845bf47cb9-2vx7r" Jul 24 03:30:57.032005 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.031986 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jdbv2\"" Jul 24 03:30:57.032102 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.032039 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 24 03:30:57.036138 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.036101 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-845bf47cb9-2vx7r"] Jul 24 03:30:57.108150 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.108109 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs848\" (UniqueName: \"kubernetes.io/projected/26a6384f-f1ac-4ab9-af83-0f5e2f929899-kube-api-access-zs848\") pod \"authorino-845bf47cb9-2vx7r\" (UID: \"26a6384f-f1ac-4ab9-af83-0f5e2f929899\") " pod="kuadrant-system/authorino-845bf47cb9-2vx7r" Jul 24 03:30:57.108150 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.108154 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/26a6384f-f1ac-4ab9-af83-0f5e2f929899-tls-cert\") pod \"authorino-845bf47cb9-2vx7r\" (UID: \"26a6384f-f1ac-4ab9-af83-0f5e2f929899\") " pod="kuadrant-system/authorino-845bf47cb9-2vx7r" Jul 24 03:30:57.209066 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.209028 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs848\" (UniqueName: \"kubernetes.io/projected/26a6384f-f1ac-4ab9-af83-0f5e2f929899-kube-api-access-zs848\") pod \"authorino-845bf47cb9-2vx7r\" (UID: \"26a6384f-f1ac-4ab9-af83-0f5e2f929899\") " pod="kuadrant-system/authorino-845bf47cb9-2vx7r" Jul 24 03:30:57.209066 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.209071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/26a6384f-f1ac-4ab9-af83-0f5e2f929899-tls-cert\") pod \"authorino-845bf47cb9-2vx7r\" (UID: \"26a6384f-f1ac-4ab9-af83-0f5e2f929899\") " pod="kuadrant-system/authorino-845bf47cb9-2vx7r" Jul 24 03:30:57.211652 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.211621 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/26a6384f-f1ac-4ab9-af83-0f5e2f929899-tls-cert\") pod \"authorino-845bf47cb9-2vx7r\" (UID: \"26a6384f-f1ac-4ab9-af83-0f5e2f929899\") " pod="kuadrant-system/authorino-845bf47cb9-2vx7r" Jul 24 03:30:57.217367 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.217337 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs848\" (UniqueName: \"kubernetes.io/projected/26a6384f-f1ac-4ab9-af83-0f5e2f929899-kube-api-access-zs848\") pod \"authorino-845bf47cb9-2vx7r\" (UID: \"26a6384f-f1ac-4ab9-af83-0f5e2f929899\") " pod="kuadrant-system/authorino-845bf47cb9-2vx7r" Jul 24 03:30:57.339344 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.339245 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-845bf47cb9-2vx7r" Jul 24 03:30:57.479687 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.479663 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-845bf47cb9-2vx7r"] Jul 24 03:30:57.481568 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:30:57.481537 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26a6384f_f1ac_4ab9_af83_0f5e2f929899.slice/crio-1907993aa2f7608d6c75c9c2f3d7a2bebf830d816aa3f9d40c79e24a9e67cf5b WatchSource:0}: Error finding container 1907993aa2f7608d6c75c9c2f3d7a2bebf830d816aa3f9d40c79e24a9e67cf5b: Status 404 returned error can't find the container with id 1907993aa2f7608d6c75c9c2f3d7a2bebf830d816aa3f9d40c79e24a9e67cf5b Jul 24 03:30:57.606551 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:57.606470 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-845bf47cb9-2vx7r" event={"ID":"26a6384f-f1ac-4ab9-af83-0f5e2f929899","Type":"ContainerStarted","Data":"1907993aa2f7608d6c75c9c2f3d7a2bebf830d816aa3f9d40c79e24a9e67cf5b"} Jul 24 03:30:58.613634 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:58.613597 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-845bf47cb9-2vx7r" event={"ID":"26a6384f-f1ac-4ab9-af83-0f5e2f929899","Type":"ContainerStarted","Data":"4cf99779b55ee25f77078fa2b94961cfcb5664a337c12741abc2166f0b9315b7"} Jul 24 03:30:58.632159 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:30:58.632102 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-845bf47cb9-2vx7r" podStartSLOduration=1.225750245 podStartE2EDuration="1.632087469s" totalImagesPullingTime="406.337224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:30:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:30:58.630593035 +0000 UTC m=+782.205242967" watchObservedRunningTime="2026-07-24 03:30:58.632087469 +0000 UTC m=+782.206737402" Jul 24 03:31:23.986765 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:31:23.986666 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:31:35.698079 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:31:35.698045 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:31:44.197489 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:31:44.197450 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:31:54.294269 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:31:54.294231 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:32:56.810592 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:32:56.810519 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:32:56.811061 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:32:56.810983 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:32:56.818043 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:32:56.818018 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:32:56.818427 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:32:56.818402 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:33:31.689077 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:33:31.689028 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:33:42.583168 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:33:42.583134 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:34:17.395455 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:34:17.395415 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:34:27.185016 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:34:27.184928 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:34:35.887696 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:34:35.887656 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:34:46.983891 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:34:46.983856 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:34:56.583657 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:34:56.583615 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:35:08.187703 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:35:08.187662 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:35:18.798390 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:35:18.798353 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:35:27.483433 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:35:27.483393 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:35:52.491874 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:35:52.491775 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:36:01.486320 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:36:01.486265 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:36:25.988962 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:36:25.988928 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:36:36.588581 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:36:36.588549 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:36:50.891562 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:36:50.891531 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:37:01.995635 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:37:01.995602 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:37:11.604406 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:37:11.604371 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:37:21.587626 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:37:21.587544 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:37:31.186387 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:37:31.186347 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:37:56.840459 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:37:56.840433 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:37:56.842665 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:37:56.842639 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:37:56.847859 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:37:56.847838 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:37:56.849757 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:37:56.849741 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:39:17.603251 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:39:17.603214 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:39:28.588051 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:39:28.588014 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:39:37.294060 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:39:37.294019 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:39:50.896556 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:39:50.896521 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:40:00.584584 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:40:00.584548 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:40:10.684384 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:40:10.684349 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:40:20.890549 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:40:20.890467 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:40:30.488460 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:40:30.488424 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:40:42.292623 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:40:42.292584 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:40:51.192287 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:40:51.192252 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:41:01.991347 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:01.991310 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:41:23.283861 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:23.283823 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:41:32.289798 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:32.289762 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:41:47.484148 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:47.484113 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:41:55.066450 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.066408 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn"] Jul 24 03:41:55.070322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.070271 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.072887 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.072865 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-07de6cda-kserve-self-signed-certs\"" Jul 24 03:41:55.080613 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.080589 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn"] Jul 24 03:41:55.192878 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.192840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-home\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.192878 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.192888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr9gs\" (UniqueName: \"kubernetes.io/projected/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-kube-api-access-qr9gs\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.193089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.192947 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tls-certs\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.193089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.193002 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-model-cache\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.193089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.193045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-dshm\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.193089 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.193065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tmp-dir\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.293832 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.293794 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tls-certs\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.294015 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.293846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-model-cache\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.294015 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.293894 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-dshm\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.294015 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.293909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tmp-dir\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.294015 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.293956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-home\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.294015 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.293980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr9gs\" (UniqueName: \"kubernetes.io/projected/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-kube-api-access-qr9gs\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.294427 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.294402 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-model-cache\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.294427 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.294414 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-home\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.294576 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.294479 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tmp-dir\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.296309 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.296258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-dshm\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.296590 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.296572 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tls-certs\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.302772 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.302747 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr9gs\" (UniqueName: \"kubernetes.io/projected/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-kube-api-access-qr9gs\") pod \"e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.380403 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.380303 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:41:55.520567 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.520539 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn"] Jul 24 03:41:55.522555 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:41:55.522530 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod767d6063_a933_4ac7_b8b2_56d54fbd2dbf.slice/crio-8b56c210ab1a9469feb80d17d5a71070951d645225839d6571c9079bb23db280 WatchSource:0}: Error finding container 8b56c210ab1a9469feb80d17d5a71070951d645225839d6571c9079bb23db280: Status 404 returned error can't find the container with id 8b56c210ab1a9469feb80d17d5a71070951d645225839d6571c9079bb23db280 Jul 24 03:41:55.910129 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.910086 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" event={"ID":"767d6063-a933-4ac7-b8b2-56d54fbd2dbf","Type":"ContainerStarted","Data":"8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f"} Jul 24 03:41:55.910333 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.910140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" event={"ID":"767d6063-a933-4ac7-b8b2-56d54fbd2dbf","Type":"ContainerStarted","Data":"8b56c210ab1a9469feb80d17d5a71070951d645225839d6571c9079bb23db280"} Jul 24 03:41:55.928061 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:55.928010 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" podStartSLOduration=0.927994062 podStartE2EDuration="927.994062ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:41:55.926121519 +0000 UTC m=+1439.500771452" watchObservedRunningTime="2026-07-24 03:41:55.927994062 +0000 UTC m=+1439.502643993" Jul 24 03:41:59.199462 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:41:59.199429 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:42:05.381085 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:05.381045 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:42:05.381565 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:05.381098 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:42:05.393584 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:05.393557 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:42:05.969504 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:05.969475 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:42:25.679626 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:25.679591 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn"] Jul 24 03:42:28.516715 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:28.516675 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:42:40.700359 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:40.700318 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" podUID="767d6063-a933-4ac7-b8b2-56d54fbd2dbf" containerName="main" containerID="cri-o://8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f" gracePeriod=45 Jul 24 03:42:40.955322 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:40.955236 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:42:41.014726 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.014693 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tls-certs\") pod \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " Jul 24 03:42:41.014905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.014738 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tmp-dir\") pod \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " Jul 24 03:42:41.014905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.014789 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-home\") pod \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " Jul 24 03:42:41.014905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.014810 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-model-cache\") pod \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " Jul 24 03:42:41.014905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.014852 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr9gs\" (UniqueName: \"kubernetes.io/projected/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-kube-api-access-qr9gs\") pod \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " Jul 24 03:42:41.014905 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.014885 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-dshm\") pod \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\" (UID: \"767d6063-a933-4ac7-b8b2-56d54fbd2dbf\") " Jul 24 03:42:41.015164 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.015086 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-model-cache" (OuterVolumeSpecName: "model-cache") pod "767d6063-a933-4ac7-b8b2-56d54fbd2dbf" (UID: "767d6063-a933-4ac7-b8b2-56d54fbd2dbf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:42:41.015164 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.015101 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-home" (OuterVolumeSpecName: "home") pod "767d6063-a933-4ac7-b8b2-56d54fbd2dbf" (UID: "767d6063-a933-4ac7-b8b2-56d54fbd2dbf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:42:41.015164 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.015108 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "767d6063-a933-4ac7-b8b2-56d54fbd2dbf" (UID: "767d6063-a933-4ac7-b8b2-56d54fbd2dbf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:42:41.015417 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.015360 2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-home\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:42:41.015417 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.015385 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-model-cache\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:42:41.015417 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.015401 2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tmp-dir\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:42:41.017158 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.017134 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "767d6063-a933-4ac7-b8b2-56d54fbd2dbf" (UID: "767d6063-a933-4ac7-b8b2-56d54fbd2dbf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 03:42:41.017521 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.017499 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-dshm" (OuterVolumeSpecName: "dshm") pod "767d6063-a933-4ac7-b8b2-56d54fbd2dbf" (UID: "767d6063-a933-4ac7-b8b2-56d54fbd2dbf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 03:42:41.017590 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.017534 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-kube-api-access-qr9gs" (OuterVolumeSpecName: "kube-api-access-qr9gs") pod "767d6063-a933-4ac7-b8b2-56d54fbd2dbf" (UID: "767d6063-a933-4ac7-b8b2-56d54fbd2dbf"). InnerVolumeSpecName "kube-api-access-qr9gs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 03:42:41.116244 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.116206 2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-tls-certs\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:42:41.116244 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.116240 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr9gs\" (UniqueName: \"kubernetes.io/projected/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-kube-api-access-qr9gs\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:42:41.116480 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.116253 2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/767d6063-a933-4ac7-b8b2-56d54fbd2dbf-dshm\") on node \"ip-10-0-142-95.ec2.internal\" DevicePath \"\"" Jul 24 03:42:41.132476 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.132439 2559 generic.go:356] "Generic (PLEG): container finished" podID="767d6063-a933-4ac7-b8b2-56d54fbd2dbf" containerID="8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f" exitCode=0 Jul 24 03:42:41.132614 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.132515 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" Jul 24 03:42:41.132614 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.132528 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" event={"ID":"767d6063-a933-4ac7-b8b2-56d54fbd2dbf","Type":"ContainerDied","Data":"8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f"} Jul 24 03:42:41.132614 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.132583 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn" event={"ID":"767d6063-a933-4ac7-b8b2-56d54fbd2dbf","Type":"ContainerDied","Data":"8b56c210ab1a9469feb80d17d5a71070951d645225839d6571c9079bb23db280"} Jul 24 03:42:41.132614 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.132606 2559 scope.go:117] "RemoveContainer" containerID="8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f" Jul 24 03:42:41.141763 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.141749 2559 scope.go:117] "RemoveContainer" containerID="8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f" Jul 24 03:42:41.142014 ip-10-0-142-95 kubenswrapper[2559]: E0724 03:42:41.141996 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f\": container with ID starting with 8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f not found: ID does not exist" containerID="8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f" Jul 24 03:42:41.142079 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.142022 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f"} err="failed to get container status \"8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f\": rpc error: code = NotFound desc = could not find container \"8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f\": container with ID starting with 8b4af2264d3c8d8272310effb01089720313752f594faa98d64dccba4175213f not found: ID does not exist" Jul 24 03:42:41.154397 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.154376 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn"] Jul 24 03:42:41.158584 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.158566 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-07de6cda-kserve-7dd9689b95-n9vkn"] Jul 24 03:42:41.786298 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:41.786255 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:42:42.906639 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:42.906605 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="767d6063-a933-4ac7-b8b2-56d54fbd2dbf" path="/var/lib/kubelet/pods/767d6063-a933-4ac7-b8b2-56d54fbd2dbf/volumes" Jul 24 03:42:51.294301 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:51.294247 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:42:56.869384 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:56.869353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:42:56.872136 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:56.872110 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:42:56.877341 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:56.877321 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:42:56.879679 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:42:56.879660 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2bqmc_7631783f-0019-4817-9181-c0409dfe6ab7/ovn-acl-logging/0.log" Jul 24 03:43:03.199748 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:43:03.199708 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:43:12.393132 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:43:12.393101 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:43:21.689220 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:43:21.689140 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:43:31.790261 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:43:31.790221 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:43:40.503086 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:43:40.503046 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:43:50.198660 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:43:50.198624 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:44:03.388486 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:44:03.388449 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:44:12.492530 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:44:12.492486 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:44:22.385375 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:44:22.385337 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:44:33.988413 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:44:33.988376 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:44:43.687099 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:44:43.687063 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:44:53.596106 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:44:53.596010 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:45:04.493529 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:04.493488 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:45:14.091468 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:14.091433 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:45:23.204082 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:23.204045 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:45:30.996217 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:30.996180 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-k96br"] Jul 24 03:45:33.214138 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:33.214101 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-845bf47cb9-2vx7r_26a6384f-f1ac-4ab9-af83-0f5e2f929899/authorino/0.log" Jul 24 03:45:38.707767 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:38.707742 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nztmv_d08b636d-7425-475c-964c-4e9c97192adb/manager/0.log" Jul 24 03:45:38.820762 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:38.820728 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qx9ps_f6f68458-e863-492c-8a6c-5b7c88ca9dee/manager/0.log" Jul 24 03:45:39.070368 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:39.070343 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6scqs_4efa8c2d-c33e-468b-bad8-1c7f85397342/server/0.log" Jul 24 03:45:39.190837 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:39.190802 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qtqhm_b262659d-5b7c-4015-b783-ce0052275fea/manager/0.log" Jul 24 03:45:39.436814 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:39.436733 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75c644cf-p6hbq_4c003ac4-352e-46ac-872a-5dcdf32ecd46/copy-manifests/0.log" Jul 24 03:45:39.448168 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:39.448137 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75c644cf-p6hbq_4c003ac4-352e-46ac-872a-5dcdf32ecd46/manager/0.log" Jul 24 03:45:40.240591 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:40.240551 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-scwqw_891ced35-6317-4d39-901a-ee6e07882f1a/postgres/0.log" Jul 24 03:45:41.548681 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:41.548651 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-845bf47cb9-2vx7r_26a6384f-f1ac-4ab9-af83-0f5e2f929899/authorino/0.log" Jul 24 03:45:41.665559 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:41.665528 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8gskz_33399732-fa01-4478-835d-7e57efd3c10d/manager/0.log" Jul 24 03:45:41.778123 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:41.778099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7lj2z_7512a4cf-a34d-413a-b039-ff290a4e377b/manager/0.log" Jul 24 03:45:42.017862 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:42.017831 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bpgwf_7fb2569f-40ab-4946-a6de-314c4d8bef5a/registry-server/0.log" Jul 24 03:45:42.264177 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:42.264148 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-k96br_37516ab4-fee1-4338-b5f1-3d072190237b/limitador/0.log" Jul 24 03:45:42.384796 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:42.384717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-v4v4c_47977d54-dc21-4fb3-b463-cab1186eac59/manager/0.log" Jul 24 03:45:43.105460 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:43.105429 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccbc5c95c-vf6lw_ce67ee07-9832-433c-983c-4086c36b81a4/kube-auth-proxy/0.log" Jul 24 03:45:43.223429 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:43.223393 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-d24gs_5294ee2d-0568-4328-9715-dda3cfc0b778/istio-proxy/1.log" Jul 24 03:45:43.595024 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:43.594997 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f88b97c-dvxwx_cb09d7be-7af6-49c0-bc46-5c27691156ce/router/0.log" Jul 24 03:45:43.935811 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:43.935725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5hzkk_01a27ba4-8b37-493a-90f0-a8b22d5dc1dd/main/0.log" Jul 24 03:45:44.054255 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:44.054220 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-q868x_6bbc80fc-8c19-4fc6-996e-7e7d851b6a69/main/0.log" Jul 24 03:45:50.430696 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.430660 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f2589/must-gather-lrcvg"] Jul 24 03:45:50.431072 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.431060 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="767d6063-a933-4ac7-b8b2-56d54fbd2dbf" containerName="main" Jul 24 03:45:50.431072 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.431072 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="767d6063-a933-4ac7-b8b2-56d54fbd2dbf" containerName="main" Jul 24 03:45:50.431147 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.431143 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="767d6063-a933-4ac7-b8b2-56d54fbd2dbf" containerName="main" Jul 24 03:45:50.434476 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.434458 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2589/must-gather-lrcvg" Jul 24 03:45:50.437934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.437902 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f2589\"/\"kube-root-ca.crt\"" Jul 24 03:45:50.438034 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.438004 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f2589\"/\"default-dockercfg-294hf\"" Jul 24 03:45:50.439025 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.439007 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f2589\"/\"openshift-service-ca.crt\"" Jul 24 03:45:50.446186 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.446164 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2589/must-gather-lrcvg"] Jul 24 03:45:50.577367 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.577334 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8d57ae2d-a2e1-4f14-8113-91b573ac2cc3-must-gather-output\") pod \"must-gather-lrcvg\" (UID: \"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3\") " pod="openshift-must-gather-f2589/must-gather-lrcvg" Jul 24 03:45:50.577367 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.577379 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp6js\" (UniqueName: \"kubernetes.io/projected/8d57ae2d-a2e1-4f14-8113-91b573ac2cc3-kube-api-access-pp6js\") pod \"must-gather-lrcvg\" (UID: \"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3\") " pod="openshift-must-gather-f2589/must-gather-lrcvg" Jul 24 03:45:50.678468 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.678435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8d57ae2d-a2e1-4f14-8113-91b573ac2cc3-must-gather-output\") pod \"must-gather-lrcvg\" (UID: \"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3\") " pod="openshift-must-gather-f2589/must-gather-lrcvg" Jul 24 03:45:50.678468 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.678474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp6js\" (UniqueName: \"kubernetes.io/projected/8d57ae2d-a2e1-4f14-8113-91b573ac2cc3-kube-api-access-pp6js\") pod \"must-gather-lrcvg\" (UID: \"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3\") " pod="openshift-must-gather-f2589/must-gather-lrcvg" Jul 24 03:45:50.678787 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.678765 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8d57ae2d-a2e1-4f14-8113-91b573ac2cc3-must-gather-output\") pod \"must-gather-lrcvg\" (UID: \"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3\") " pod="openshift-must-gather-f2589/must-gather-lrcvg" Jul 24 03:45:50.691581 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.691517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp6js\" (UniqueName: \"kubernetes.io/projected/8d57ae2d-a2e1-4f14-8113-91b573ac2cc3-kube-api-access-pp6js\") pod \"must-gather-lrcvg\" (UID: \"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3\") " pod="openshift-must-gather-f2589/must-gather-lrcvg" Jul 24 03:45:50.743804 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.743756 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2589/must-gather-lrcvg" Jul 24 03:45:50.907590 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.907564 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2589/must-gather-lrcvg"] Jul 24 03:45:50.908587 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:45:50.908562 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d57ae2d_a2e1_4f14_8113_91b573ac2cc3.slice/crio-59e0a0ce84f567b60311429ea7d8d2a2e153dabcf1d9198efaa3522a6968232f WatchSource:0}: Error finding container 59e0a0ce84f567b60311429ea7d8d2a2e153dabcf1d9198efaa3522a6968232f: Status 404 returned error can't find the container with id 59e0a0ce84f567b60311429ea7d8d2a2e153dabcf1d9198efaa3522a6968232f Jul 24 03:45:50.910408 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:50.910392 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 03:45:51.079207 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:51.079174 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2589/must-gather-lrcvg" event={"ID":"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3","Type":"ContainerStarted","Data":"59e0a0ce84f567b60311429ea7d8d2a2e153dabcf1d9198efaa3522a6968232f"} Jul 24 03:45:52.098016 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:52.097906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2589/must-gather-lrcvg" event={"ID":"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3","Type":"ContainerStarted","Data":"c31b7be876ffde6be3a1df3ba9aca410c88d80d3d1bd493063a59b13bd1c7e33"} Jul 24 03:45:52.098016 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:52.097979 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2589/must-gather-lrcvg" event={"ID":"8d57ae2d-a2e1-4f14-8113-91b573ac2cc3","Type":"ContainerStarted","Data":"f22754e4400ee976fc0fc6cb06d0626c0c41bcdaff1d805ce8195998123281a5"} Jul 24 03:45:52.120305 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:52.117762 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f2589/must-gather-lrcvg" podStartSLOduration=1.369296121 podStartE2EDuration="2.117741779s" totalImagesPullingTime="748.445658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 03:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:45:52.114620249 +0000 UTC m=+1675.689270181" watchObservedRunningTime="2026-07-24 03:45:52.117741779 +0000 UTC m=+1675.692391712" Jul 24 03:45:53.295580 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:53.295535 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b25hj_22cf01fa-32a1-49b0-9722-d3fbd4fcb738/global-pull-secret-syncer/0.log" Jul 24 03:45:53.412528 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:53.412498 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k2bwb_3c0d2909-d462-42a6-b748-4bfa4d3016b3/konnectivity-agent/0.log" Jul 24 03:45:53.508130 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:53.508058 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-95.ec2.internal_07c01ed83c1ca76d7a45565c7e1bd3b3/haproxy/0.log" Jul 24 03:45:58.417264 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:58.417201 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-845bf47cb9-2vx7r_26a6384f-f1ac-4ab9-af83-0f5e2f929899/authorino/0.log" Jul 24 03:45:58.490497 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:58.490470 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8gskz_33399732-fa01-4478-835d-7e57efd3c10d/manager/0.log" Jul 24 03:45:58.567695 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:58.567656 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-7lj2z_7512a4cf-a34d-413a-b039-ff290a4e377b/manager/0.log" Jul 24 03:45:58.714574 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:58.714426 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bpgwf_7fb2569f-40ab-4946-a6de-314c4d8bef5a/registry-server/0.log" Jul 24 03:45:59.021477 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:59.021435 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-k96br_37516ab4-fee1-4338-b5f1-3d072190237b/limitador/0.log" Jul 24 03:45:59.114690 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:45:59.114647 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-v4v4c_47977d54-dc21-4fb3-b463-cab1186eac59/manager/0.log" Jul 24 03:46:01.074421 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:01.074381 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-lknbs_746d05c8-e84f-4fab-92a7-4dd04f4878f6/cluster-monitoring-operator/0.log" Jul 24 03:46:01.382161 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:01.382057 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5rrs7_588f275f-2849-4276-bb1a-be7a6097e857/node-exporter/0.log" Jul 24 03:46:01.422774 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:01.422719 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5rrs7_588f275f-2849-4276-bb1a-be7a6097e857/kube-rbac-proxy/0.log" Jul 24 03:46:01.490503 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:01.490469 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5rrs7_588f275f-2849-4276-bb1a-be7a6097e857/init-textfile/0.log" Jul 24 03:46:02.999340 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:02.997306 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f2589/perf-node-gather-daemonset-29flb"] Jul 24 03:46:03.005085 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.005055 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.038934 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.038897 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2589/perf-node-gather-daemonset-29flb"] Jul 24 03:46:03.121729 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.121500 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-podres\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.121729 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.121562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-lib-modules\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.121729 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.121585 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgh4z\" (UniqueName: \"kubernetes.io/projected/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-kube-api-access-mgh4z\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.121729 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.121616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-proc\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.121729 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.121652 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-sys\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.222916 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.222873 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-lib-modules\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.223146 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.222923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgh4z\" (UniqueName: \"kubernetes.io/projected/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-kube-api-access-mgh4z\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.223146 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.222978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-proc\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.223146 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.223014 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-sys\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.223146 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.223117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-podres\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.223428 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.223302 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-podres\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.223428 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.223405 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-lib-modules\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.223786 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.223763 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-proc\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.223864 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.223822 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-sys\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.236705 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.236668 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgh4z\" (UniqueName: \"kubernetes.io/projected/34cb244f-39a1-4f1d-80bf-e0c91b04f0fb-kube-api-access-mgh4z\") pod \"perf-node-gather-daemonset-29flb\" (UID: \"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb\") " pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.315694 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.315595 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:03.521167 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:03.520800 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2589/perf-node-gather-daemonset-29flb"] Jul 24 03:46:03.524480 ip-10-0-142-95 kubenswrapper[2559]: W0724 03:46:03.524449 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod34cb244f_39a1_4f1d_80bf_e0c91b04f0fb.slice/crio-87b6a9c017ac997f769a3418d131a4f0283775d2f3f4a5ec927fae817d1531ca WatchSource:0}: Error finding container 87b6a9c017ac997f769a3418d131a4f0283775d2f3f4a5ec927fae817d1531ca: Status 404 returned error can't find the container with id 87b6a9c017ac997f769a3418d131a4f0283775d2f3f4a5ec927fae817d1531ca Jul 24 03:46:04.021316 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:04.021266 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-fn82q_7b3df521-c842-467d-a7b6-d9c089ff6119/networking-console-plugin/0.log" Jul 24 03:46:04.191762 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:04.191730 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" event={"ID":"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb","Type":"ContainerStarted","Data":"5c8b305b34ef5b90479d04a6846848064a83366f1632dab6bc0a045894df04a1"} Jul 24 03:46:04.191948 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:04.191791 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" event={"ID":"34cb244f-39a1-4f1d-80bf-e0c91b04f0fb","Type":"ContainerStarted","Data":"87b6a9c017ac997f769a3418d131a4f0283775d2f3f4a5ec927fae817d1531ca"} Jul 24 03:46:04.191948 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:04.191834 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:04.722796 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:04.722757 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/1.log" Jul 24 03:46:04.729052 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:04.729020 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-rs8hf_538669b7-54b4-4f39-b542-932532b0aede/console-operator/2.log" Jul 24 03:46:06.027574 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:06.027549 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-htdpv_93c8b475-4fc6-4f2a-af38-bba514265f42/volume-data-source-validator/0.log" Jul 24 03:46:07.054793 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:07.054761 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jj77_68348238-a827-4623-a962-75d06e9c76e3/dns/0.log" Jul 24 03:46:07.075714 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:07.075688 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6jj77_68348238-a827-4623-a962-75d06e9c76e3/kube-rbac-proxy/0.log" Jul 24 03:46:07.224630 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:07.224601 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l8k4p_035aef4d-c1ba-4acf-abe0-00149bc69aaa/dns-node-resolver/0.log" Jul 24 03:46:07.816573 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:07.816544 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2gfsv_2d202ea7-a61f-4339-817b-2c19f914f343/node-ca/0.log" Jul 24 03:46:09.008613 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:09.008584 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccbc5c95c-vf6lw_ce67ee07-9832-433c-983c-4086c36b81a4/kube-auth-proxy/0.log" Jul 24 03:46:09.036563 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:09.036517 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-d24gs_5294ee2d-0568-4328-9715-dda3cfc0b778/istio-proxy/0.log" Jul 24 03:46:09.067974 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:09.067930 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-d24gs_5294ee2d-0568-4328-9715-dda3cfc0b778/istio-proxy/1.log" Jul 24 03:46:09.167050 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:09.167024 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f88b97c-dvxwx_cb09d7be-7af6-49c0-bc46-5c27691156ce/router/0.log" Jul 24 03:46:09.799756 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:09.799729 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5c5zc_079af452-eef5-404b-91da-d8ad6c511629/serve-healthcheck-canary/0.log" Jul 24 03:46:10.210817 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:10.210791 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" Jul 24 03:46:10.230538 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:10.230472 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f2589/perf-node-gather-daemonset-29flb" podStartSLOduration=8.230451203 podStartE2EDuration="8.230451203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 03:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 03:46:04.223259409 +0000 UTC m=+1687.797909342" watchObservedRunningTime="2026-07-24 03:46:10.230451203 +0000 UTC m=+1693.805101137" Jul 24 03:46:10.347542 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:10.347509 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-5p6ql_6169a7c8-6149-41c8-8b99-61f49d40a0d5/insights-operator/0.log" Jul 24 03:46:10.347974 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:10.347954 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-5p6ql_6169a7c8-6149-41c8-8b99-61f49d40a0d5/insights-operator/1.log" Jul 24 03:46:10.498834 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:10.498807 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr826_d7c8f9d5-ef5f-438e-87cc-72d0a6926423/kube-rbac-proxy/0.log" Jul 24 03:46:10.519214 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:10.519188 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr826_d7c8f9d5-ef5f-438e-87cc-72d0a6926423/exporter/0.log" Jul 24 03:46:10.542591 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:10.542561 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xr826_d7c8f9d5-ef5f-438e-87cc-72d0a6926423/extractor/0.log" Jul 24 03:46:13.039013 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:13.038981 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nztmv_d08b636d-7425-475c-964c-4e9c97192adb/manager/0.log" Jul 24 03:46:13.139583 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:13.139550 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qx9ps_f6f68458-e863-492c-8a6c-5b7c88ca9dee/manager/0.log" Jul 24 03:46:13.282738 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:13.282663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6scqs_4efa8c2d-c33e-468b-bad8-1c7f85397342/server/0.log" Jul 24 03:46:13.340498 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:13.340466 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-qtqhm_b262659d-5b7c-4015-b783-ce0052275fea/manager/0.log" Jul 24 03:46:13.459250 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:13.459219 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75c644cf-p6hbq_4c003ac4-352e-46ac-872a-5dcdf32ecd46/manager/0.log" Jul 24 03:46:13.477548 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:13.477521 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c75c644cf-p6hbq_4c003ac4-352e-46ac-872a-5dcdf32ecd46/copy-manifests/0.log" Jul 24 03:46:13.972572 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:13.972547 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccbc5c95c-vf6lw_ce67ee07-9832-433c-983c-4086c36b81a4/kube-auth-proxy/0.log" Jul 24 03:46:13.993075 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:13.993044 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-d24gs_5294ee2d-0568-4328-9715-dda3cfc0b778/istio-proxy/0.log" Jul 24 03:46:14.025424 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:14.025231 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-d24gs_5294ee2d-0568-4328-9715-dda3cfc0b778/istio-proxy/1.log" Jul 24 03:46:14.093126 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:14.093099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f88b97c-dvxwx_cb09d7be-7af6-49c0-bc46-5c27691156ce/router/0.log" Jul 24 03:46:15.333178 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:15.333144 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7ccbc5c95c-vf6lw_ce67ee07-9832-433c-983c-4086c36b81a4/kube-auth-proxy/0.log" Jul 24 03:46:15.357880 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:15.357856 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-d24gs_5294ee2d-0568-4328-9715-dda3cfc0b778/istio-proxy/0.log" Jul 24 03:46:15.389618 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:15.389586 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-d24gs_5294ee2d-0568-4328-9715-dda3cfc0b778/istio-proxy/1.log" Jul 24 03:46:15.458884 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:15.458789 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f88b97c-dvxwx_cb09d7be-7af6-49c0-bc46-5c27691156ce/router/0.log" Jul 24 03:46:19.379304 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:19.379213 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-ll9pv_0e049f70-2d0d-4423-ad57-5be0c28756b8/migrator/0.log" Jul 24 03:46:19.398459 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:19.398431 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-ll9pv_0e049f70-2d0d-4423-ad57-5be0c28756b8/graceful-termination/0.log" Jul 24 03:46:19.803599 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:19.803566 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj_e1f10169-faf5-4ac3-a695-85d4a238de8f/kube-storage-version-migrator-operator/1.log" Jul 24 03:46:19.805183 ip-10-0-142-95 kubenswrapper[2559]: I0724 03:46:19.805156 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-z8zbj_e1f10169-faf5-4ac3-a695-85d4a238de8f/kube-storage-version-migrator-operator/0.log"