Jul 15 04:56:36.395489 ip-10-0-134-241 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 04:56:36.395503 ip-10-0-134-241 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 04:56:36.395514 ip-10-0-134-241 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 04:56:36.395857 ip-10-0-134-241 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 04:56:46.076897 ip-10-0-134-241 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 04:56:46.076914 ip-10-0-134-241 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 71b771e6388745659affcd9de72b0d70 -- Jul 15 04:58:34.042694 ip-10-0-134-241 systemd[1]: Starting Kubernetes Kubelet... Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.450728 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457472 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457498 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457502 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457505 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457508 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457512 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457515 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:58:35.667196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457518 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:58:35.626777 ip-10-0-134-241 systemd[1]: Started Kubernetes Kubelet. Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457521 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457524 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457527 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457530 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457533 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457535 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457539 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457551 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457555 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457560 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457564 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457568 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457571 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457574 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457578 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457581 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457584 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457587 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:58:35.668708 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457589 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457592 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457595 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457598 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457600 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457604 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457606 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457609 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457612 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457614 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457618 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457622 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457625 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457628 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457631 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457634 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457636 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457639 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457642 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457645 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:58:35.669771 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457647 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457650 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457653 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457655 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457660 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457663 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457665 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457668 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457672 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457697 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457700 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457704 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457708 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457712 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457716 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457719 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457723 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457727 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457730 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457734 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:58:35.670547 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457738 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457748 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457754 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457758 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457762 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457767 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457771 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457775 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457778 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457782 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457785 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457789 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457794 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457798 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457804 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457808 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457811 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457817 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457821 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:58:35.671339 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457824 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457828 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457834 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457839 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457843 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457848 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457854 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457859 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457863 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457868 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457873 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457877 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457882 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.457887 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.458984 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.458996 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459001 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459005 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459009 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:58:35.672196 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459013 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459020 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459026 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459030 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459033 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459037 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459041 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459048 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459053 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459057 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459061 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459065 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459072 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459076 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459080 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459085 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459089 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459093 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459097 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:58:35.673190 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459101 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459104 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459108 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459113 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459117 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459121 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459126 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459130 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459135 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459139 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459143 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459147 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459151 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459156 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459161 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459164 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459168 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459172 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459175 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459180 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:58:35.674147 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459183 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459187 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459190 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459197 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459200 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459204 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459209 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459214 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459219 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459222 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459227 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459231 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459235 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459239 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459242 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459244 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459247 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459251 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459255 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459259 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:58:35.675096 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459264 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459268 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459272 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459277 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459282 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459286 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459290 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459294 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459297 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459301 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459306 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459310 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459315 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459318 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459322 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459326 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459330 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459337 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459358 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:58:35.676077 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459365 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459369 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459374 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459378 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459383 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459387 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459391 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459395 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459399 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459404 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459412 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459416 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459420 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459428 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459432 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459437 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459976 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459984 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459989 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459992 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:58:35.677001 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459995 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.459998 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460002 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460004 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460007 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460010 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460012 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460015 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460018 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460020 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460023 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460026 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460029 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460032 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460035 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460041 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460045 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460048 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460050 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460058 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:58:35.677585 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460061 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460064 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460067 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460069 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460072 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460074 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460077 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460080 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460082 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460085 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460088 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460090 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460093 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460095 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460098 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460101 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460103 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460111 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460114 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460117 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:58:35.678220 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460119 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460122 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460124 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460127 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460131 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460136 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460140 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460145 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460148 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460151 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460154 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460159 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460162 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460165 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460170 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460174 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460176 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460179 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460182 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:58:35.679063 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460185 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460187 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460190 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460193 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460195 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460198 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460200 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460203 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460205 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460208 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460210 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460213 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460216 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460218 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460221 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460223 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460226 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460229 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460233 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:58:35.679691 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460237 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460242 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460245 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460248 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460250 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460255 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460258 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460260 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460263 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460266 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460268 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460271 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460273 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460276 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460278 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460281 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.460283 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460383 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460393 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460401 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460414 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 04:58:35.680317 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460419 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460422 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460427 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460431 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460434 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460437 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460441 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460445 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460448 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460451 2555 flags.go:64] FLAG: --cgroup-root="" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460455 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460458 2555 flags.go:64] FLAG: --client-ca-file="" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460479 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460483 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460488 2555 flags.go:64] FLAG: --cluster-domain="" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460491 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460496 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460499 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460502 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460507 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460510 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460513 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460516 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460519 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 15 04:58:35.680937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460522 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460525 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460529 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460532 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460536 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460539 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460542 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460545 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460548 2555 flags.go:64] FLAG: --enable-server="true" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460551 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460556 2555 flags.go:64] FLAG: --event-burst="100" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460560 2555 flags.go:64] FLAG: --event-qps="50" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460563 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460567 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460570 2555 flags.go:64] FLAG: --eviction-hard="" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460574 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460577 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460580 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460583 2555 flags.go:64] FLAG: --eviction-soft="" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460586 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460590 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460594 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460597 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460600 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460605 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 04:58:35.681567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460608 2555 flags.go:64] FLAG: --feature-gates="" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460613 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460616 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460619 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460622 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460625 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460628 2555 flags.go:64] FLAG: --help="false" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460631 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-134-241.ec2.internal" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460634 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460637 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460640 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460644 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460647 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460650 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460653 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460656 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460659 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460662 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460665 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460668 2555 flags.go:64] FLAG: --kube-reserved="" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460672 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460674 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460678 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460680 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 04:58:35.682396 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460683 2555 flags.go:64] FLAG: --lock-file="" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460686 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460689 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460696 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460702 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460705 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460708 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460713 2555 flags.go:64] FLAG: --logging-format="text" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460716 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460719 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460722 2555 flags.go:64] FLAG: --manifest-url="" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460725 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460730 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460733 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460737 2555 flags.go:64] FLAG: --max-pods="110" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460741 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460744 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460747 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460750 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460753 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460756 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460759 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460767 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460770 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460774 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 04:58:35.830582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460777 2555 flags.go:64] FLAG: --pod-cidr="" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460780 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460786 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460789 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460793 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460796 2555 flags.go:64] FLAG: --port="10250" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460799 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460801 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c62f1547d19614e" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460805 2555 flags.go:64] FLAG: --qos-reserved="" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460808 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460812 2555 flags.go:64] FLAG: --register-node="true" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460815 2555 flags.go:64] FLAG: --register-with-taints="" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460819 2555 flags.go:64] FLAG: --registry-burst="10" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460823 2555 flags.go:64] FLAG: --registry-qps="5" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460827 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460831 2555 flags.go:64] FLAG: --reserved-memory="" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460835 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460838 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460842 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460845 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460848 2555 flags.go:64] FLAG: --runonce="false" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460851 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460854 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460857 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460860 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 04:58:35.845383 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460862 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460865 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460868 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460871 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460874 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460877 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460880 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460883 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460886 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460889 2555 flags.go:64] FLAG: --system-cgroups="" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460891 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460897 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460900 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460903 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460907 2555 flags.go:64] FLAG: --tls-min-version="" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460911 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460914 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460918 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460921 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460924 2555 flags.go:64] FLAG: --v="2" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460928 2555 flags.go:64] FLAG: --version="false" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460943 2555 flags.go:64] FLAG: --vmodule="" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460949 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.460953 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 04:58:35.849410 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461091 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461095 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461100 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461104 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461107 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461110 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461113 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461116 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461120 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461123 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461126 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461128 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461131 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461134 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461136 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461139 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461142 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461144 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461147 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:58:35.850143 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461149 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461152 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461154 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461157 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461159 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461162 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461167 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461169 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461172 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461175 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461177 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461183 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461185 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461188 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461190 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461193 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461196 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461199 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461201 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461204 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:58:35.850748 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461206 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461209 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461211 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461214 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461216 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461219 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461222 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461224 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461227 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461230 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461233 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461237 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461240 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461242 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461245 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461248 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461251 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461253 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461258 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:58:35.851457 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461260 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461263 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461265 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461269 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461272 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461276 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461279 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461281 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461284 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461286 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461289 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461292 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461294 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461297 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461299 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461302 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461304 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461307 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461310 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461312 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:58:35.852019 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461314 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461317 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461320 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461322 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461325 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461327 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461330 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461333 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461335 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461338 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461354 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461359 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461363 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461368 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461371 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461373 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461379 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461381 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461388 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:58:35.852609 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461392 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.461395 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.462247 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.470382 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.470410 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.470436 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.470446 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470512 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470517 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470521 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470524 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470526 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470529 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470532 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470535 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:58:35.853200 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470537 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470540 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470542 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470545 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470548 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470551 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470553 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470556 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470558 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470565 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470567 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470570 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470573 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470576 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470579 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470583 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470586 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470589 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470591 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470594 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:58:35.853667 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470596 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470600 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470602 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470605 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470607 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470610 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470612 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470615 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470618 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470620 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470623 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470626 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470628 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470631 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470633 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470636 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470638 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470641 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470643 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470647 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:58:35.854233 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470651 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470656 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470659 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470662 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470665 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470669 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470672 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470675 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470678 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470681 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470684 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470687 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470690 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470692 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470695 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470698 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470701 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470704 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470706 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470709 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:58:35.854840 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470711 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470714 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470717 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470720 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470722 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470725 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470727 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470730 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470733 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470735 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470738 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470740 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470744 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470751 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470754 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470757 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470760 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470763 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470766 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:58:35.855401 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470770 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470773 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470776 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470779 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470782 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470785 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470788 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470790 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470793 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470796 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470799 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470801 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.470807 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470928 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470934 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 04:58:36.022129 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470937 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470940 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470943 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470946 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470948 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470951 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470954 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470958 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470961 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470963 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470967 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470971 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470973 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470976 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470979 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470981 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470983 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470986 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470990 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 04:58:36.023082 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470993 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470995 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.470998 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471000 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471003 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471006 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471008 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471012 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471015 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471018 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471020 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471023 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471025 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471028 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471030 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471033 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471036 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471038 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471042 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 04:58:36.024116 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471045 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471048 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471051 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471054 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471056 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471060 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471063 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471065 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471068 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471070 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471073 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471075 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471080 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471083 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471086 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471088 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471091 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471093 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471096 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471098 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 04:58:36.024761 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471101 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471104 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471107 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471109 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471112 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471114 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471117 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471119 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471122 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471124 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471127 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471131 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471134 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471137 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471140 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471143 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471146 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471150 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471152 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471156 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 04:58:36.025373 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471159 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471161 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471164 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471166 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471172 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471174 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471177 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471180 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471182 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471185 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471188 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471190 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471193 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471196 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471198 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471201 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471203 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471206 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 04:58:36.025996 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:34.471208 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.471213 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.471387 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.473453 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.474740 2555 server.go:1019] "Starting client certificate rotation" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.474855 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:34.474896 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.569601 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.576433 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.591742 2555 log.go:25] "Validated CRI v1 runtime API" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.593940 2555 log.go:25] "Validated CRI v1 image API" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.594756 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 04:58:36.026610 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.599058 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 04:58:36.027026 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.601338 2555 fs.go:135] Filesystem UUIDs: map[518ee5f2-164a-46ac-a9bd-89bedbbeaf71:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d62fb1e8-628e-4868-b893-178be7c51190:/dev/nvme0n1p4] Jul 15 04:58:36.027026 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.601356 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.606355 2555 manager.go:216] Machine: {Timestamp:2026-07-15 04:58:35.604794296 +0000 UTC m=+0.338454436 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098964 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26de5d1e9b66405bf2a4e5097f76fe SystemUUID:ec26de5d-1e9b-6640-5bf2-a4e5097f76fe BootID:71b771e6-3887-4565-9aff-cd9de72b0d70 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e5:b1:04:fc:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e5:b1:04:fc:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:03:d8:5b:cf:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.606469 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.606555 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.610080 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.610114 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.611412 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.611423 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.611432 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.612036 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.613162 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616046 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616192 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616223 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616241 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616258 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616269 2555 kubelet.go:398] "Adding apiserver pod source" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616281 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 04:58:36.028460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616675 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.616690 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.618781 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.620591 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.620619 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.620868 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.620882 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.620888 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.620894 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.620902 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.620908 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.621287 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.621294 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.621301 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.621307 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.621315 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.621336 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.621995 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.622005 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.625614 2555 server.go:1268] "Started kubelet" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.625698 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.625793 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.626000 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.638096 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.640760 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.640811 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.640952 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.641370 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.641996 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.640983 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-241.ec2.internal.18c25dc7eba6aa8e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-241.ec2.internal,UID:ip-10-0-134-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-241.ec2.internal,},FirstTimestamp:2026-07-15 04:58:35.625581198 +0000 UTC m=+0.359241338,LastTimestamp:2026-07-15 04:58:35.625581198 +0000 UTC m=+0.359241338,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-241.ec2.internal,}" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.643163 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.643230 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.643358 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.643735 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.643737 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.643762 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.643881 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.643890 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.644121 2555 factory.go:55] Registering systemd factory Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.644133 2555 factory.go:223] Registration of the systemd container factory successfully Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.644401 2555 factory.go:153] Registering CRI-O factory Jul 15 04:58:36.029049 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.644417 2555 factory.go:223] Registration of the crio container factory successfully Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.644489 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.644528 2555 factory.go:103] Registering Raw factory Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.644547 2555 manager.go:1196] Started watching for new ooms in manager Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.645140 2555 manager.go:349] Starting recovery of all containers Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.646088 2555 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.646299 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.651421 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5lbfm" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.656029 2555 manager.go:354] Recovery completed Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.656843 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5lbfm" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.663595 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.665626 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.665655 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.665666 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.666307 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.666315 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.666330 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.666425 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.667289 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.667315 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.667326 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.667651 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-241.ec2.internal.18c25dc7ee09fa73 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-241.ec2.internal,UID:ip-10-0-134-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-241.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-241.ec2.internal,},FirstTimestamp:2026-07-15 04:58:35.665644147 +0000 UTC m=+0.399304289,LastTimestamp:2026-07-15 04:58:35.665644147 +0000 UTC m=+0.399304289,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-241.ec2.internal,}" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.667769 2555 policy_none.go:49] "None policy: Start" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.667788 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.667803 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.668807 2555 policy_none.go:47] "Start" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.705413 2555 manager.go:337] "Starting Device Plugin manager" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.705634 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.705646 2555 server.go:87] "Starting device plugin registration server" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.705942 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.705955 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.706063 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.706166 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.706180 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.706655 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.706702 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.787456 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.788716 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.788764 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 04:58:36.030253 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.788793 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.788836 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.791152 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.806839 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.807835 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.807865 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.807877 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.807901 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.816676 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.816700 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-241.ec2.internal\": node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.849211 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.888933 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal"] Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.889010 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.890016 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.890045 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.890056 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.891390 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.891506 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.891548 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.892089 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.892111 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.892126 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.892160 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.892178 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.892186 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.898479 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.898507 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.899276 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientMemory" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.899300 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.899310 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeHasSufficientPID" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.913962 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-241.ec2.internal\" not found" node="ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.919526 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-241.ec2.internal\" not found" node="ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:35.949852 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.949927 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4bac0d5aef81006c66c4c79f72062e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal\" (UID: \"a4bac0d5aef81006c66c4c79f72062e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.031305 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.949966 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4bac0d5aef81006c66c4c79f72062e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal\" (UID: \"a4bac0d5aef81006c66c4c79f72062e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.032319 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:35.949983 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98260bfd566f14ae3c27b8cadea6e987-config\") pod \"kube-apiserver-proxy-ip-10-0-134-241.ec2.internal\" (UID: \"98260bfd566f14ae3c27b8cadea6e987\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.192915 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.049938 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.192915 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.051065 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4bac0d5aef81006c66c4c79f72062e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal\" (UID: \"a4bac0d5aef81006c66c4c79f72062e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.192915 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.051093 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98260bfd566f14ae3c27b8cadea6e987-config\") pod \"kube-apiserver-proxy-ip-10-0-134-241.ec2.internal\" (UID: \"98260bfd566f14ae3c27b8cadea6e987\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.192915 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.051123 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4bac0d5aef81006c66c4c79f72062e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal\" (UID: \"a4bac0d5aef81006c66c4c79f72062e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.192915 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.051171 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4bac0d5aef81006c66c4c79f72062e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal\" (UID: \"a4bac0d5aef81006c66c4c79f72062e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.192915 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.051173 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4bac0d5aef81006c66c4c79f72062e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal\" (UID: \"a4bac0d5aef81006c66c4c79f72062e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.192915 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.051174 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98260bfd566f14ae3c27b8cadea6e987-config\") pod \"kube-apiserver-proxy-ip-10-0-134-241.ec2.internal\" (UID: \"98260bfd566f14ae3c27b8cadea6e987\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.192915 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.150828 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.310683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.216108 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.310683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.226176 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.310683 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.250923 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.446281 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.351379 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.596075 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.451917 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.596075 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.552449 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.596075 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.565706 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 04:58:36.596075 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.565893 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 04:58:36.726884 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.618063 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:58:36.726884 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.638943 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:58:36.726884 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.653446 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.726884 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.660663 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 04:53:35 +0000 UTC" deadline="2028-01-22 05:36:45.82763643 +0000 UTC" Jul 15 04:58:36.726884 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.660708 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13344h38m9.166933843s" Jul 15 04:58:36.872248 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.754126 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.872248 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:36.809133 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98260bfd566f14ae3c27b8cadea6e987.slice/crio-7d431c2dfb0b7b4aceadc9718c24bd085cf61adcc8f132d21ca36596e92dbac3 WatchSource:0}: Error finding container 7d431c2dfb0b7b4aceadc9718c24bd085cf61adcc8f132d21ca36596e92dbac3: Status 404 returned error can't find the container with id 7d431c2dfb0b7b4aceadc9718c24bd085cf61adcc8f132d21ca36596e92dbac3 Jul 15 04:58:36.872248 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.814270 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 04:58:36.872248 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:36.824246 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bac0d5aef81006c66c4c79f72062e4.slice/crio-b767069323c382c6f8f3878aa648b328fcc1d576f78ba44bd820a31a7b18e1e9 WatchSource:0}: Error finding container b767069323c382c6f8f3878aa648b328fcc1d576f78ba44bd820a31a7b18e1e9: Status 404 returned error can't find the container with id b767069323c382c6f8f3878aa648b328fcc1d576f78ba44bd820a31a7b18e1e9 Jul 15 04:58:36.872248 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:36.855010 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-241.ec2.internal\" not found" Jul 15 04:58:36.988274 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.877454 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:58:36.988274 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.944419 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.988274 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.972397 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 04:58:36.988274 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.973454 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" Jul 15 04:58:36.988274 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:36.981429 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 04:58:37.617574 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.617308 2555 apiserver.go:52] "Watching apiserver" Jul 15 04:58:37.626832 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.626801 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 04:58:37.627292 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.627263 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-xxqhm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-ktznd","openshift-cluster-node-tuning-operator/tuned-vz5vq","openshift-image-registry/node-ca-fvlwf","openshift-multus/multus-65b8p","openshift-multus/multus-additional-cni-plugins-pk4kz","openshift-multus/network-metrics-daemon-f45b8","openshift-network-diagnostics/network-check-target-rskgr","openshift-network-operator/iptables-alerter-4lwws","kube-system/global-pull-secret-syncer-28pt6","kube-system/konnectivity-agent-krghk","kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw"] Jul 15 04:58:37.630115 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.630091 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.632582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.632467 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.632582 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.632501 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-crgbt\"" Jul 15 04:58:37.632793 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.632595 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 04:58:37.632793 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.632609 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 04:58:37.633105 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.632889 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 04:58:37.633105 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.632894 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 04:58:37.634247 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.634227 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5tz74\"" Jul 15 04:58:37.634699 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.634682 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 04:58:37.634906 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.634891 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 04:58:37.635831 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.635812 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.638255 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.638197 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 04:58:37.638410 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.638394 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 04:58:37.639066 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.638524 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 04:58:37.639066 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.638665 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 04:58:37.639066 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.638798 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4szt8\"" Jul 15 04:58:37.639066 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.638916 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 04:58:37.639066 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.639008 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 04:58:37.643342 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.643319 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.645364 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.645339 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 04:58:37.645455 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.645401 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 04:58:37.645604 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.645591 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b8twq\"" Jul 15 04:58:37.647678 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.647465 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.647907 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.647892 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 04:58:37.649449 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.649431 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 04:58:37.649626 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.649607 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 04:58:37.649718 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.649661 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 04:58:37.649799 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.649780 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k9fk8\"" Jul 15 04:58:37.650048 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.650024 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.651765 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.651743 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 04:58:37.651865 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.651844 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lvkcd\"" Jul 15 04:58:37.651935 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.651890 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:58:37.652601 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.652579 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:37.652708 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.652677 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:37.655527 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.655508 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:37.655642 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.655594 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:37.658335 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.658314 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.659811 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.659788 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-systemd\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660611 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660624 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660648 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-ovnkube-script-lib\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660694 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84x2t\" (UniqueName: \"kubernetes.io/projected/fb3b9f40-853a-4bba-aee5-05f07618156a-kube-api-access-84x2t\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660744 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-k8s-cni-cncf-io\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660767 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-etc-kubernetes\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660785 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-cni-bin\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-cni-netd\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660830 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-cni-binary-copy\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bz5r\" (UniqueName: \"kubernetes.io/projected/0d7128a3-fa59-4204-ab55-fb0748896cba-kube-api-access-5bz5r\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660882 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjnk7\" (UniqueName: \"kubernetes.io/projected/7ab27930-ab90-4b71-b886-177912fc9147-kube-api-access-wjnk7\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-os-release\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-socket-dir-parent\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660978 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-slash\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.660998 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661109 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-run-netns\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.661369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661115 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wdjp5\"" Jul 15 04:58:37.662318 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-var-lib-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.662318 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661157 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-log-socket\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.662318 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-cni-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.662318 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661247 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-daemon-config\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.662318 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661288 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-ovn\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.662318 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661315 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.662318 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661515 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.664227 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.661374 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.664335 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.664408 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-netns\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.664492 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-hostroot\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.664543 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-conf-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.664574 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-multus-certs\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.664829 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmfrg\" (UniqueName: \"kubernetes.io/projected/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-kube-api-access-dmfrg\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.664958 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-cnibin\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.665007 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-cnibin\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.665183 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d7128a3-fa59-4204-ab55-fb0748896cba-cni-binary-copy\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.665345 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-hosts-file\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.665380 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-env-overrides\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.665409 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m4p5\" (UniqueName: \"kubernetes.io/projected/20fc919f-3fd8-4273-8254-a7843def7714-kube-api-access-7m4p5\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.665441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-tmp-dir\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.666266 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.665937 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-kubelet\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666107 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ab27930-ab90-4b71-b886-177912fc9147-host\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666190 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-system-cni-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666236 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-cni-bin\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666283 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-kubelet\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666329 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-etc-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666384 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ab27930-ab90-4b71-b886-177912fc9147-serviceca\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666419 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-node-log\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-ovnkube-config\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20fc919f-3fd8-4273-8254-a7843def7714-ovn-node-metrics-cert\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666530 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-system-cni-dir\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666568 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-os-release\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-cni-multus\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.667140 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.666783 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-systemd-units\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.669314 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.669216 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krghk" Jul 15 04:58:37.671998 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.671842 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 04:58:37.672122 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.672098 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l6gdd\"" Jul 15 04:58:37.672209 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.672189 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 04:58:37.672799 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.672767 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.676041 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.676021 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 04:58:37.676299 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.676282 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fbn89\"" Jul 15 04:58:37.676480 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.676454 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 04:58:37.676670 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.676652 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 04:58:37.693123 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.693096 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qkjlr" Jul 15 04:58:37.701369 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.700980 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qkjlr" Jul 15 04:58:37.745457 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.745412 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 04:58:37.768061 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768012 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-kubernetes\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.768061 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768062 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-lib-modules\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.768314 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768096 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-k8s-cni-cncf-io\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.768314 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768123 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-cni-bin\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768314 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768182 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-cni-bin\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768314 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768216 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-k8s-cni-cncf-io\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.768314 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768257 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-cni-netd\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768314 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768300 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-cni-binary-copy\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.768570 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768365 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-cni-netd\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768570 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768416 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-socket-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.768570 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768452 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bz5r\" (UniqueName: \"kubernetes.io/projected/0d7128a3-fa59-4204-ab55-fb0748896cba-kube-api-access-5bz5r\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.768570 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768492 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjnk7\" (UniqueName: \"kubernetes.io/projected/7ab27930-ab90-4b71-b886-177912fc9147-kube-api-access-wjnk7\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.768570 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768521 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-socket-dir-parent\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.768570 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768541 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-slash\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768570 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768562 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-run-netns\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768660 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-var-lib-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-log-socket\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768705 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.768968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-cni-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.768968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768787 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cbb754d-f476-4b2e-bd0f-c613a7032b51-konnectivity-ca\") pod \"konnectivity-agent-krghk\" (UID: \"8cbb754d-f476-4b2e-bd0f-c613a7032b51\") " pod="kube-system/konnectivity-agent-krghk" Jul 15 04:58:37.768968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-device-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.768968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768834 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysconfig\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.768968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.768861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysctl-d\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.769367 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769009 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-hostroot\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.769367 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769042 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-conf-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.769367 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769098 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-multus-certs\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.769367 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769103 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-log-socket\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.769367 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769141 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-cnibin\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.769367 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysctl-conf\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.769367 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769251 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxpsh\" (UniqueName: \"kubernetes.io/projected/bdab8570-f78a-493b-ab3e-6f208aae11af-kube-api-access-rxpsh\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.769367 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769272 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-cni-binary-copy\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769370 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-hosts-file\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769378 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769405 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769453 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-sys\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769462 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-slash\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769490 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20fc919f-3fd8-4273-8254-a7843def7714-ovn-node-metrics-cert\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769541 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769569 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-tmp-dir\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769598 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ab27930-ab90-4b71-b886-177912fc9147-host\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769614 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-kubelet\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769634 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-socket-dir-parent\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769636 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cfsz\" (UniqueName: \"kubernetes.io/projected/1c409fad-5859-4dd0-9a50-a47c6979d303-kube-api-access-5cfsz\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769665 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-run-netns\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.769709 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769705 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-var-lib-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769718 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-conf-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769783 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-cnibin\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769826 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-cni-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769851 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ab27930-ab90-4b71-b886-177912fc9147-serviceca\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769880 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-ovnkube-config\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769880 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7ab27930-ab90-4b71-b886-177912fc9147-host\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769907 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-system-cni-dir\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769738 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-multus-certs\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769940 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-hosts-file\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.769997 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-tuned\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770011 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c409fad-5859-4dd0-9a50-a47c6979d303-tmp\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770026 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdab8570-f78a-493b-ab3e-6f208aae11af-host-slash\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770044 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-systemd-units\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770062 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-ovnkube-script-lib\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770081 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-hostroot\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770092 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-kubelet\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.770361 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770092 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-systemd-units\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770097 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84x2t\" (UniqueName: \"kubernetes.io/projected/fb3b9f40-853a-4bba-aee5-05f07618156a-kube-api-access-84x2t\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770142 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdf81bc9-ded5-40e1-a816-ad48da30874a-kubelet-config\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770182 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-system-cni-dir\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770172 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-sys-fs\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770044 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-tmp-dir\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770268 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-host\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770321 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-etc-kubernetes\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770380 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-os-release\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770413 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770456 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cbb754d-f476-4b2e-bd0f-c613a7032b51-agent-certs\") pod \"konnectivity-agent-krghk\" (UID: \"8cbb754d-f476-4b2e-bd0f-c613a7032b51\") " pod="kube-system/konnectivity-agent-krghk" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-daemon-config\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770517 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-etc-kubernetes\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770536 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7ab27930-ab90-4b71-b886-177912fc9147-serviceca\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770587 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-run-ovn-kubernetes\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770594 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-ovnkube-config\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770539 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-ovn\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.771234 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770648 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-ovn\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770656 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-os-release\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770754 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770807 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdf81bc9-ded5-40e1-a816-ad48da30874a-dbus\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-var-lib-kubelet\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.770938 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771035 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-ovnkube-script-lib\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771222 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0d7128a3-fa59-4204-ab55-fb0748896cba-multus-daemon-config\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771497 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-netns\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771533 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmfrg\" (UniqueName: \"kubernetes.io/projected/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-kube-api-access-dmfrg\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-systemd\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771583 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-run\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771596 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-run-netns\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771633 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzm8z\" (UniqueName: \"kubernetes.io/projected/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-kube-api-access-wzm8z\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771661 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-cnibin\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d7128a3-fa59-4204-ab55-fb0748896cba-cni-binary-copy\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771714 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-env-overrides\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772078 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771756 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m4p5\" (UniqueName: \"kubernetes.io/projected/20fc919f-3fd8-4273-8254-a7843def7714-kube-api-access-7m4p5\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771754 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771814 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-cnibin\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771963 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-registration-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.771993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqvhj\" (UniqueName: \"kubernetes.io/projected/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-kube-api-access-bqvhj\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772015 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-node-log\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772036 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-os-release\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772056 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772102 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772126 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-kubelet\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772152 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-system-cni-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772172 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-node-log\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772178 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-cni-bin\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772243 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-os-release\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772258 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/20fc919f-3fd8-4273-8254-a7843def7714-env-overrides\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772259 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-etc-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772283 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d7128a3-fa59-4204-ab55-fb0748896cba-cni-binary-copy\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.772968 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772291 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-host-kubelet\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772226 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-cni-bin\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772333 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-etc-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772335 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-modprobe-d\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772352 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-system-cni-dir\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772378 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdab8570-f78a-493b-ab3e-6f208aae11af-iptables-alerter-script\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772420 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-cni-multus\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772449 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb3b9f40-853a-4bba-aee5-05f07618156a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772458 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-systemd\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772481 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772503 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-systemd\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772458 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0d7128a3-fa59-4204-ab55-fb0748896cba-host-var-lib-cni-multus\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.772568 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/20fc919f-3fd8-4273-8254-a7843def7714-run-openvswitch\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.773775 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.773286 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fb3b9f40-853a-4bba-aee5-05f07618156a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.774698 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.774676 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/20fc919f-3fd8-4273-8254-a7843def7714-ovn-node-metrics-cert\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.777249 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.777224 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjnk7\" (UniqueName: \"kubernetes.io/projected/7ab27930-ab90-4b71-b886-177912fc9147-kube-api-access-wjnk7\") pod \"node-ca-fvlwf\" (UID: \"7ab27930-ab90-4b71-b886-177912fc9147\") " pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.778430 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.778369 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bz5r\" (UniqueName: \"kubernetes.io/projected/0d7128a3-fa59-4204-ab55-fb0748896cba-kube-api-access-5bz5r\") pod \"multus-65b8p\" (UID: \"0d7128a3-fa59-4204-ab55-fb0748896cba\") " pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.780292 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.780266 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84x2t\" (UniqueName: \"kubernetes.io/projected/fb3b9f40-853a-4bba-aee5-05f07618156a-kube-api-access-84x2t\") pod \"multus-additional-cni-plugins-pk4kz\" (UID: \"fb3b9f40-853a-4bba-aee5-05f07618156a\") " pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.780387 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.780273 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmfrg\" (UniqueName: \"kubernetes.io/projected/3ce77b74-fbf5-4ff1-b59f-e72e96651f95-kube-api-access-dmfrg\") pod \"node-resolver-xxqhm\" (UID: \"3ce77b74-fbf5-4ff1-b59f-e72e96651f95\") " pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.782747 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.782445 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m4p5\" (UniqueName: \"kubernetes.io/projected/20fc919f-3fd8-4273-8254-a7843def7714-kube-api-access-7m4p5\") pod \"ovnkube-node-ktznd\" (UID: \"20fc919f-3fd8-4273-8254-a7843def7714\") " pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.793823 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.793761 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" event={"ID":"a4bac0d5aef81006c66c4c79f72062e4","Type":"ContainerStarted","Data":"b767069323c382c6f8f3878aa648b328fcc1d576f78ba44bd820a31a7b18e1e9"} Jul 15 04:58:37.794915 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.794887 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" event={"ID":"98260bfd566f14ae3c27b8cadea6e987","Type":"ContainerStarted","Data":"7d431c2dfb0b7b4aceadc9718c24bd085cf61adcc8f132d21ca36596e92dbac3"} Jul 15 04:58:37.873150 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873071 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873150 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873112 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-tuned\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873150 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c409fad-5859-4dd0-9a50-a47c6979d303-tmp\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873150 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873145 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdab8570-f78a-493b-ab3e-6f208aae11af-host-slash\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873161 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdf81bc9-ded5-40e1-a816-ad48da30874a-kubelet-config\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873178 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-sys-fs\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873191 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-host\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873194 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cbb754d-f476-4b2e-bd0f-c613a7032b51-agent-certs\") pod \"konnectivity-agent-krghk\" (UID: \"8cbb754d-f476-4b2e-bd0f-c613a7032b51\") " pod="kube-system/konnectivity-agent-krghk" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873248 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdf81bc9-ded5-40e1-a816-ad48da30874a-dbus\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873266 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-var-lib-kubelet\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873281 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873299 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-systemd\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873315 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-run\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873330 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzm8z\" (UniqueName: \"kubernetes.io/projected/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-kube-api-access-wzm8z\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873351 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-registration-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873367 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqvhj\" (UniqueName: \"kubernetes.io/projected/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-kube-api-access-bqvhj\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873384 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873388 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-modprobe-d\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdab8570-f78a-493b-ab3e-6f208aae11af-iptables-alerter-script\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873436 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-kubernetes\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873452 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-lib-modules\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873473 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-socket-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873496 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cbb754d-f476-4b2e-bd0f-c613a7032b51-konnectivity-ca\") pod \"konnectivity-agent-krghk\" (UID: \"8cbb754d-f476-4b2e-bd0f-c613a7032b51\") " pod="kube-system/konnectivity-agent-krghk" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873564 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-registration-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873613 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-device-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873642 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysconfig\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysctl-d\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873698 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysctl-conf\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873739 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxpsh\" (UniqueName: \"kubernetes.io/projected/bdab8570-f78a-493b-ab3e-6f208aae11af-kube-api-access-rxpsh\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873770 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873795 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-sys\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873812 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873833 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cfsz\" (UniqueName: \"kubernetes.io/projected/1c409fad-5859-4dd0-9a50-a47c6979d303-kube-api-access-5cfsz\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.873924 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873863 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdf81bc9-ded5-40e1-a816-ad48da30874a-kubelet-config\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873911 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-sys-fs\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873936 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-var-lib-kubelet\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873980 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-host\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.873977 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8cbb754d-f476-4b2e-bd0f-c613a7032b51-konnectivity-ca\") pod \"konnectivity-agent-krghk\" (UID: \"8cbb754d-f476-4b2e-bd0f-c613a7032b51\") " pod="kube-system/konnectivity-agent-krghk" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.874024 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.874098 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:38.374077003 +0000 UTC m=+3.107737155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874133 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-modprobe-d\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874143 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-systemd\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874148 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-lib-modules\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-run\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874203 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-kubernetes\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874215 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-etc-selinux\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874258 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdab8570-f78a-493b-ab3e-6f208aae11af-host-slash\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874298 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-socket-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874314 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-sys\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.874378 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:37.874683 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.874420 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret podName:fdf81bc9-ded5-40e1-a816-ad48da30874a nodeName:}" failed. No retries permitted until 2026-07-15 04:58:38.374405284 +0000 UTC m=+3.108065421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret") pod "global-pull-secret-syncer-28pt6" (UID: "fdf81bc9-ded5-40e1-a816-ad48da30874a") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:37.875487 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874442 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-device-dir\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.875487 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874506 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysconfig\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.875487 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874547 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdf81bc9-ded5-40e1-a816-ad48da30874a-dbus\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:37.875487 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874614 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysctl-d\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.875487 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.874645 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-sysctl-conf\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.875487 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.875190 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdab8570-f78a-493b-ab3e-6f208aae11af-iptables-alerter-script\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.875834 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.875711 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1c409fad-5859-4dd0-9a50-a47c6979d303-etc-tuned\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.876331 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.876304 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1c409fad-5859-4dd0-9a50-a47c6979d303-tmp\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.876767 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.876750 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8cbb754d-f476-4b2e-bd0f-c613a7032b51-agent-certs\") pod \"konnectivity-agent-krghk\" (UID: \"8cbb754d-f476-4b2e-bd0f-c613a7032b51\") " pod="kube-system/konnectivity-agent-krghk" Jul 15 04:58:37.881375 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.881305 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:58:37.881375 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.881331 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:58:37.881375 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.881346 2555 projected.go:196] Error preparing data for projected volume kube-api-access-t5rlm for pod openshift-network-diagnostics/network-check-target-rskgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:37.881649 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:37.881419 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm podName:7baa6030-ed2c-47aa-8eed-a59dfa2d1f33 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:38.381398297 +0000 UTC m=+3.115058457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t5rlm" (UniqueName: "kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm") pod "network-check-target-rskgr" (UID: "7baa6030-ed2c-47aa-8eed-a59dfa2d1f33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:37.883700 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.883676 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cfsz\" (UniqueName: \"kubernetes.io/projected/1c409fad-5859-4dd0-9a50-a47c6979d303-kube-api-access-5cfsz\") pod \"tuned-vz5vq\" (UID: \"1c409fad-5859-4dd0-9a50-a47c6979d303\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:37.883891 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.883868 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxpsh\" (UniqueName: \"kubernetes.io/projected/bdab8570-f78a-493b-ab3e-6f208aae11af-kube-api-access-rxpsh\") pod \"iptables-alerter-4lwws\" (UID: \"bdab8570-f78a-493b-ab3e-6f208aae11af\") " pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:37.883980 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.883963 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzm8z\" (UniqueName: \"kubernetes.io/projected/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-kube-api-access-wzm8z\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:37.884074 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.884056 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqvhj\" (UniqueName: \"kubernetes.io/projected/3ee8a287-ef2c-4cea-898a-a5d8beb7907a-kube-api-access-bqvhj\") pod \"aws-ebs-csi-driver-node-h5lnw\" (UID: \"3ee8a287-ef2c-4cea-898a-a5d8beb7907a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:37.909237 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.909206 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 04:58:37.950170 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.950137 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65b8p" Jul 15 04:58:37.959212 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.959187 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xxqhm" Jul 15 04:58:37.972002 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.971970 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:58:37.979768 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.979740 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" Jul 15 04:58:37.987534 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.987495 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fvlwf" Jul 15 04:58:37.995258 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:37.995229 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" Jul 15 04:58:38.005083 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:38.005048 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4lwws" Jul 15 04:58:38.012855 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:38.012826 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krghk" Jul 15 04:58:38.019601 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:38.019578 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" Jul 15 04:58:38.377539 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:38.377502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:38.377717 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:38.377570 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:38.377717 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:38.377656 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:38.377717 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:38.377678 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:38.377943 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:38.377741 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:39.377709617 +0000 UTC m=+4.111369744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:38.377943 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:38.377762 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret podName:fdf81bc9-ded5-40e1-a816-ad48da30874a nodeName:}" failed. No retries permitted until 2026-07-15 04:58:39.377752018 +0000 UTC m=+4.111412144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret") pod "global-pull-secret-syncer-28pt6" (UID: "fdf81bc9-ded5-40e1-a816-ad48da30874a") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:38.478024 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:38.477992 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:38.478180 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:38.478121 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:58:38.478180 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:38.478136 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:58:38.478180 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:38.478144 2555 projected.go:196] Error preparing data for projected volume kube-api-access-t5rlm for pod openshift-network-diagnostics/network-check-target-rskgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:38.478343 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:38.478196 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm podName:7baa6030-ed2c-47aa-8eed-a59dfa2d1f33 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:39.478182665 +0000 UTC m=+4.211842809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5rlm" (UniqueName: "kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm") pod "network-check-target-rskgr" (UID: "7baa6030-ed2c-47aa-8eed-a59dfa2d1f33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:38.703865 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:38.703782 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 04:53:37 +0000 UTC" deadline="2028-02-18 01:19:59.439854747 +0000 UTC" Jul 15 04:58:38.703865 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:38.703815 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13988h21m20.736042521s" Jul 15 04:58:38.833681 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.833609 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7128a3_fa59_4204_ab55_fb0748896cba.slice/crio-83f5a278b42d8d6ae82f2e10a7215c901e0df43b70487437624e1fa8e7e6a402 WatchSource:0}: Error finding container 83f5a278b42d8d6ae82f2e10a7215c901e0df43b70487437624e1fa8e7e6a402: Status 404 returned error can't find the container with id 83f5a278b42d8d6ae82f2e10a7215c901e0df43b70487437624e1fa8e7e6a402 Jul 15 04:58:38.842963 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.842934 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fc919f_3fd8_4273_8254_a7843def7714.slice/crio-1224d5a1d3414c0a16dfc1d035dac7585e1f4471365dd7b49f69a7dd0972f08d WatchSource:0}: Error finding container 1224d5a1d3414c0a16dfc1d035dac7585e1f4471365dd7b49f69a7dd0972f08d: Status 404 returned error can't find the container with id 1224d5a1d3414c0a16dfc1d035dac7585e1f4471365dd7b49f69a7dd0972f08d Jul 15 04:58:38.844298 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.844272 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce77b74_fbf5_4ff1_b59f_e72e96651f95.slice/crio-4d02a35f3aa5a75bcd3cb5a4dc4181ecb0e9e1e81c07c22e25ff7de02c9075c8 WatchSource:0}: Error finding container 4d02a35f3aa5a75bcd3cb5a4dc4181ecb0e9e1e81c07c22e25ff7de02c9075c8: Status 404 returned error can't find the container with id 4d02a35f3aa5a75bcd3cb5a4dc4181ecb0e9e1e81c07c22e25ff7de02c9075c8 Jul 15 04:58:38.845674 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.845646 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3b9f40_853a_4bba_aee5_05f07618156a.slice/crio-026ae8503479df19290a331a2c212c099dde127a98f7bc4424f4a26b36e1a72f WatchSource:0}: Error finding container 026ae8503479df19290a331a2c212c099dde127a98f7bc4424f4a26b36e1a72f: Status 404 returned error can't find the container with id 026ae8503479df19290a331a2c212c099dde127a98f7bc4424f4a26b36e1a72f Jul 15 04:58:38.846873 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.846848 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab27930_ab90_4b71_b886_177912fc9147.slice/crio-10d578a9b3b06fbd075d42d1ef356f844f7613d17a7e0ad7d03332c5dca4150c WatchSource:0}: Error finding container 10d578a9b3b06fbd075d42d1ef356f844f7613d17a7e0ad7d03332c5dca4150c: Status 404 returned error can't find the container with id 10d578a9b3b06fbd075d42d1ef356f844f7613d17a7e0ad7d03332c5dca4150c Jul 15 04:58:38.869192 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.869163 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ee8a287_ef2c_4cea_898a_a5d8beb7907a.slice/crio-9226ba3231b85857493ddce6364c578684261ff24d07b66f547474b969d4b4f4 WatchSource:0}: Error finding container 9226ba3231b85857493ddce6364c578684261ff24d07b66f547474b969d4b4f4: Status 404 returned error can't find the container with id 9226ba3231b85857493ddce6364c578684261ff24d07b66f547474b969d4b4f4 Jul 15 04:58:38.870736 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.870693 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdab8570_f78a_493b_ab3e_6f208aae11af.slice/crio-9483267fe5ded65d92da5113cde3ff6c2dc6bc799b30a64df72b7a53d80bdee1 WatchSource:0}: Error finding container 9483267fe5ded65d92da5113cde3ff6c2dc6bc799b30a64df72b7a53d80bdee1: Status 404 returned error can't find the container with id 9483267fe5ded65d92da5113cde3ff6c2dc6bc799b30a64df72b7a53d80bdee1 Jul 15 04:58:38.871599 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.871566 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbb754d_f476_4b2e_bd0f_c613a7032b51.slice/crio-1295141cf50a9c1806ed0446e378340b38a6b2117d4947fb671aa55debf1813c WatchSource:0}: Error finding container 1295141cf50a9c1806ed0446e378340b38a6b2117d4947fb671aa55debf1813c: Status 404 returned error can't find the container with id 1295141cf50a9c1806ed0446e378340b38a6b2117d4947fb671aa55debf1813c Jul 15 04:58:38.872504 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:58:38.872480 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c409fad_5859_4dd0_9a50_a47c6979d303.slice/crio-acfc64be6cb14d0fe3282712ba9e58f0d1eb070c8e9a28f9b2f498fddf811900 WatchSource:0}: Error finding container acfc64be6cb14d0fe3282712ba9e58f0d1eb070c8e9a28f9b2f498fddf811900: Status 404 returned error can't find the container with id acfc64be6cb14d0fe3282712ba9e58f0d1eb070c8e9a28f9b2f498fddf811900 Jul 15 04:58:39.386675 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.386411 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:39.386869 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.386757 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:39.386929 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.386919 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:39.387000 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.386991 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:41.386973061 +0000 UTC m=+6.120633193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:39.387400 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.387383 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:39.387476 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.387438 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret podName:fdf81bc9-ded5-40e1-a816-ad48da30874a nodeName:}" failed. No retries permitted until 2026-07-15 04:58:41.387422782 +0000 UTC m=+6.121082913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret") pod "global-pull-secret-syncer-28pt6" (UID: "fdf81bc9-ded5-40e1-a816-ad48da30874a") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:39.487804 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.487762 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:39.487972 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.487955 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:58:39.488054 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.487977 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:58:39.488054 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.487989 2555 projected.go:196] Error preparing data for projected volume kube-api-access-t5rlm for pod openshift-network-diagnostics/network-check-target-rskgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:39.488054 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.488052 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm podName:7baa6030-ed2c-47aa-8eed-a59dfa2d1f33 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:41.488034059 +0000 UTC m=+6.221694202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5rlm" (UniqueName: "kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm") pod "network-check-target-rskgr" (UID: "7baa6030-ed2c-47aa-8eed-a59dfa2d1f33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:39.704850 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.704647 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 04:53:37 +0000 UTC" deadline="2027-12-26 23:32:29.304083076 +0000 UTC" Jul 15 04:58:39.704850 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.704718 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12714h33m49.599369384s" Jul 15 04:58:39.791087 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.790869 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:39.791087 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.790879 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:39.791087 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.791008 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:39.791087 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.791023 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:39.791414 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.791113 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:39.791414 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:39.791208 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:39.810055 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.810016 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" event={"ID":"3ee8a287-ef2c-4cea-898a-a5d8beb7907a","Type":"ContainerStarted","Data":"9226ba3231b85857493ddce6364c578684261ff24d07b66f547474b969d4b4f4"} Jul 15 04:58:39.835145 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.834864 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" event={"ID":"fb3b9f40-853a-4bba-aee5-05f07618156a","Type":"ContainerStarted","Data":"026ae8503479df19290a331a2c212c099dde127a98f7bc4424f4a26b36e1a72f"} Jul 15 04:58:39.839032 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.838915 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"1224d5a1d3414c0a16dfc1d035dac7585e1f4471365dd7b49f69a7dd0972f08d"} Jul 15 04:58:39.847011 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.846905 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65b8p" event={"ID":"0d7128a3-fa59-4204-ab55-fb0748896cba","Type":"ContainerStarted","Data":"83f5a278b42d8d6ae82f2e10a7215c901e0df43b70487437624e1fa8e7e6a402"} Jul 15 04:58:39.860199 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.860073 2555 generic.go:356] "Generic (PLEG): container finished" podID="a4bac0d5aef81006c66c4c79f72062e4" containerID="7888e1358efa37d5b6aa7043e86ac1626e71561dc96c01a39e2d2ab308c4698e" exitCode=0 Jul 15 04:58:39.860199 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.860191 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" event={"ID":"a4bac0d5aef81006c66c4c79f72062e4","Type":"ContainerDied","Data":"7888e1358efa37d5b6aa7043e86ac1626e71561dc96c01a39e2d2ab308c4698e"} Jul 15 04:58:39.868127 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.868092 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" event={"ID":"1c409fad-5859-4dd0-9a50-a47c6979d303","Type":"ContainerStarted","Data":"acfc64be6cb14d0fe3282712ba9e58f0d1eb070c8e9a28f9b2f498fddf811900"} Jul 15 04:58:39.886215 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.886107 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4lwws" event={"ID":"bdab8570-f78a-493b-ab3e-6f208aae11af","Type":"ContainerStarted","Data":"9483267fe5ded65d92da5113cde3ff6c2dc6bc799b30a64df72b7a53d80bdee1"} Jul 15 04:58:39.901954 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.901810 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fvlwf" event={"ID":"7ab27930-ab90-4b71-b886-177912fc9147","Type":"ContainerStarted","Data":"10d578a9b3b06fbd075d42d1ef356f844f7613d17a7e0ad7d03332c5dca4150c"} Jul 15 04:58:39.905571 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.905536 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xxqhm" event={"ID":"3ce77b74-fbf5-4ff1-b59f-e72e96651f95","Type":"ContainerStarted","Data":"4d02a35f3aa5a75bcd3cb5a4dc4181ecb0e9e1e81c07c22e25ff7de02c9075c8"} Jul 15 04:58:39.919512 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.918697 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" event={"ID":"98260bfd566f14ae3c27b8cadea6e987","Type":"ContainerStarted","Data":"ea11d3e94acf3ed8e43e29fd3c2d993a4694b152394dcc6d5a1b742fa5e408d3"} Jul 15 04:58:39.929643 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.929599 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krghk" event={"ID":"8cbb754d-f476-4b2e-bd0f-c613a7032b51","Type":"ContainerStarted","Data":"1295141cf50a9c1806ed0446e378340b38a6b2117d4947fb671aa55debf1813c"} Jul 15 04:58:39.937027 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:39.936961 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-241.ec2.internal" podStartSLOduration=3.936939276 podStartE2EDuration="3.936939276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:58:39.936718626 +0000 UTC m=+4.670378776" watchObservedRunningTime="2026-07-15 04:58:39.936939276 +0000 UTC m=+4.670599434" Jul 15 04:58:40.961397 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:40.961165 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" event={"ID":"a4bac0d5aef81006c66c4c79f72062e4","Type":"ContainerStarted","Data":"951a7740150946bdb3253abfdb237c53370d98c54d40c9a92aec01f9e0a6136b"} Jul 15 04:58:41.405503 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:41.405463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:41.405655 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:41.405553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:41.405757 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.405742 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:41.405819 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.405806 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:45.405787728 +0000 UTC m=+10.139447868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:41.406215 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.406197 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:41.406279 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.406255 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret podName:fdf81bc9-ded5-40e1-a816-ad48da30874a nodeName:}" failed. No retries permitted until 2026-07-15 04:58:45.406239425 +0000 UTC m=+10.139899566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret") pod "global-pull-secret-syncer-28pt6" (UID: "fdf81bc9-ded5-40e1-a816-ad48da30874a") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:41.506309 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:41.506268 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:41.506584 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.506493 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:58:41.506584 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.506517 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:58:41.506584 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.506529 2555 projected.go:196] Error preparing data for projected volume kube-api-access-t5rlm for pod openshift-network-diagnostics/network-check-target-rskgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:41.506786 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.506588 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm podName:7baa6030-ed2c-47aa-8eed-a59dfa2d1f33 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:45.506568313 +0000 UTC m=+10.240228469 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5rlm" (UniqueName: "kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm") pod "network-check-target-rskgr" (UID: "7baa6030-ed2c-47aa-8eed-a59dfa2d1f33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:41.791782 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:41.791686 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:41.791964 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.791853 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:41.792271 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:41.792241 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:41.792367 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.792345 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:41.792537 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:41.792404 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:41.792537 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:41.792476 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:43.790647 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:43.789957 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:43.790647 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:43.790082 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:43.790647 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:43.790306 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:43.790647 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:43.790427 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:43.790647 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:43.790494 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:43.790647 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:43.790599 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:45.445308 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:45.445266 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:45.445904 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:45.445357 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:45.445904 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.445495 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:45.445904 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.445560 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:53.445540327 +0000 UTC m=+18.179200468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:45.446091 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.445986 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:45.446091 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.446040 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret podName:fdf81bc9-ded5-40e1-a816-ad48da30874a nodeName:}" failed. No retries permitted until 2026-07-15 04:58:53.446026044 +0000 UTC m=+18.179686174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret") pod "global-pull-secret-syncer-28pt6" (UID: "fdf81bc9-ded5-40e1-a816-ad48da30874a") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:45.546526 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:45.545840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:45.546526 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.546062 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:58:45.546526 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.546083 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:58:45.546526 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.546096 2555 projected.go:196] Error preparing data for projected volume kube-api-access-t5rlm for pod openshift-network-diagnostics/network-check-target-rskgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:45.546526 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.546160 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm podName:7baa6030-ed2c-47aa-8eed-a59dfa2d1f33 nodeName:}" failed. No retries permitted until 2026-07-15 04:58:53.546141325 +0000 UTC m=+18.279801472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5rlm" (UniqueName: "kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm") pod "network-check-target-rskgr" (UID: "7baa6030-ed2c-47aa-8eed-a59dfa2d1f33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:45.794065 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:45.793980 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:45.794254 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.794104 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:45.794492 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:45.794471 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:45.794610 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.794589 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:45.794682 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:45.794641 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:45.794752 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:45.794707 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:47.789951 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:47.789910 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:47.790402 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:47.790053 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:47.790402 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:47.790074 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:47.790402 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:47.790074 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:47.790402 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:47.790194 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:47.790402 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:47.790256 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:49.789345 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:49.789259 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:49.789763 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:49.789266 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:49.789763 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:49.789406 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:49.789763 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:49.789274 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:49.789763 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:49.789498 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:49.789763 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:49.789551 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:51.789303 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:51.789266 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:51.789303 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:51.789304 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:51.789827 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:51.789266 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:51.789827 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:51.789466 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:51.789827 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:51.789556 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:51.789827 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:51.789639 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:53.511603 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:53.511559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:53.512090 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:53.511621 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:53.512090 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.511707 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:53.512090 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.511736 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:53.512090 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.511788 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:09.511771372 +0000 UTC m=+34.245431503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:58:53.512090 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.511808 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret podName:fdf81bc9-ded5-40e1-a816-ad48da30874a nodeName:}" failed. No retries permitted until 2026-07-15 04:59:09.511797852 +0000 UTC m=+34.245457979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret") pod "global-pull-secret-syncer-28pt6" (UID: "fdf81bc9-ded5-40e1-a816-ad48da30874a") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:58:53.612434 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:53.612395 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:53.612631 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.612598 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:58:53.612631 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.612627 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:58:53.612754 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.612639 2555 projected.go:196] Error preparing data for projected volume kube-api-access-t5rlm for pod openshift-network-diagnostics/network-check-target-rskgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:53.612754 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.612702 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm podName:7baa6030-ed2c-47aa-8eed-a59dfa2d1f33 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:09.612688462 +0000 UTC m=+34.346348603 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5rlm" (UniqueName: "kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm") pod "network-check-target-rskgr" (UID: "7baa6030-ed2c-47aa-8eed-a59dfa2d1f33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:58:53.791675 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:53.791599 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:53.791823 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:53.791601 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:53.791823 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.791699 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:53.791823 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:53.791720 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:53.791823 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.791810 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:53.791938 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:53.791856 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:55.790183 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:55.790152 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:55.790647 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:55.790288 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:55.790647 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:55.790271 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:55.790647 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:55.790402 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:55.790647 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:55.790425 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:55.790912 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:55.790884 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:57.789460 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:57.789424 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:57.789934 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:57.789483 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:57.789934 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:57.789424 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:57.789934 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:57.789563 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:57.789934 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:57.789655 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:58:57.789934 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:57.789764 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:58.022292 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:58.022037 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-241.ec2.internal" podStartSLOduration=22.022017402 podStartE2EDuration="22.022017402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:58:40.975885796 +0000 UTC m=+5.709545946" watchObservedRunningTime="2026-07-15 04:58:58.022017402 +0000 UTC m=+22.755677554" Jul 15 04:58:59.004834 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.004561 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krghk" event={"ID":"8cbb754d-f476-4b2e-bd0f-c613a7032b51","Type":"ContainerStarted","Data":"c7cc6d847a645bdded6627d6efe8b9e9247f3d09736a6905efe03f23d2b82f28"} Jul 15 04:58:59.006100 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.006079 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" event={"ID":"3ee8a287-ef2c-4cea-898a-a5d8beb7907a","Type":"ContainerStarted","Data":"3252b88fba10a4cfd54c54d264abce9a224c1275fb224d713c34bdc87a81d48c"} Jul 15 04:58:59.007398 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.007377 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb3b9f40-853a-4bba-aee5-05f07618156a" containerID="2b214a4c52caeb8ff082d2372f3ad86658934c9cbc8029d41b40c36b0647acde" exitCode=0 Jul 15 04:58:59.007477 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.007445 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" event={"ID":"fb3b9f40-853a-4bba-aee5-05f07618156a","Type":"ContainerDied","Data":"2b214a4c52caeb8ff082d2372f3ad86658934c9cbc8029d41b40c36b0647acde"} Jul 15 04:58:59.010246 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.010230 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 04:58:59.010539 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.010521 2555 generic.go:356] "Generic (PLEG): container finished" podID="20fc919f-3fd8-4273-8254-a7843def7714" containerID="7f2e379ca334ad09cd4b539aa8584b0a88a879df4a6cfe2bedc2e5a95b935242" exitCode=1 Jul 15 04:58:59.010604 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.010588 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"7a0e67c8ab7434d941c849ed946930f16a5383ffbd26930ab04dff58979f6697"} Jul 15 04:58:59.010652 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.010641 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"f50a6f4ee00ab2071c29dba1cce002f78340ffb1ba71de96df143c3f0b6c7b8b"} Jul 15 04:58:59.010702 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.010674 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"29e10c4d3f5c889c86d6689ebabfd0b0e62b167bfd610825911282d33c36d306"} Jul 15 04:58:59.010754 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.010718 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"c0a8cefcd8d9f1e0bf6dc1080286193dc5ccc4f2f55f282e3f1877552971a095"} Jul 15 04:58:59.010795 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.010770 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerDied","Data":"7f2e379ca334ad09cd4b539aa8584b0a88a879df4a6cfe2bedc2e5a95b935242"} Jul 15 04:58:59.010836 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.010807 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"1fcfad4c36e68916cd8728a0f4aec266a724da190c674f2c9dc2fdbac22ada17"} Jul 15 04:58:59.011914 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.011896 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65b8p" event={"ID":"0d7128a3-fa59-4204-ab55-fb0748896cba","Type":"ContainerStarted","Data":"8ea8a7926964e52a744f83b7c65229d6db8055fc66432c7d1b7fc8e14212320f"} Jul 15 04:58:59.013330 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.013308 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" event={"ID":"1c409fad-5859-4dd0-9a50-a47c6979d303","Type":"ContainerStarted","Data":"ca7b17fb5f47397c2429945b0ddcbef7bb8953d0df65139e7b1f08236d3e31f0"} Jul 15 04:58:59.014620 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.014600 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fvlwf" event={"ID":"7ab27930-ab90-4b71-b886-177912fc9147","Type":"ContainerStarted","Data":"3c70c78a8fc9a2e794ab0c86b1caaa0c66359a8f9798140d650b25362dd4dd3e"} Jul 15 04:58:59.015917 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.015893 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xxqhm" event={"ID":"3ce77b74-fbf5-4ff1-b59f-e72e96651f95","Type":"ContainerStarted","Data":"e2264a0f1845c58812a8c1240152319ba33202b4e2e58e39448727f1601521cc"} Jul 15 04:58:59.020857 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.020818 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-krghk" podStartSLOduration=4.056515755 podStartE2EDuration="23.020804631s" totalImagesPullingTime="18.964288876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:58:59.020246435 +0000 UTC m=+23.753906596" watchObservedRunningTime="2026-07-15 04:58:59.020804631 +0000 UTC m=+23.754464780" Jul 15 04:58:59.036537 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.036485 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-65b8p" podStartSLOduration=4.950327968 podStartE2EDuration="24.036468648s" totalImagesPullingTime="19.08614068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:58:59.036174319 +0000 UTC m=+23.769834469" watchObservedRunningTime="2026-07-15 04:58:59.036468648 +0000 UTC m=+23.770128797" Jul 15 04:58:59.050297 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.050229 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xxqhm" podStartSLOduration=5.066200736 podStartE2EDuration="24.050213144s" totalImagesPullingTime="18.984012408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:58:59.049646966 +0000 UTC m=+23.783307126" watchObservedRunningTime="2026-07-15 04:58:59.050213144 +0000 UTC m=+23.783873293" Jul 15 04:58:59.064970 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.064910 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vz5vq" podStartSLOduration=4.063560768 podStartE2EDuration="23.064892556s" totalImagesPullingTime="19.001331788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:58:59.064720829 +0000 UTC m=+23.798380978" watchObservedRunningTime="2026-07-15 04:58:59.064892556 +0000 UTC m=+23.798552705" Jul 15 04:58:59.108843 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.108794 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fvlwf" podStartSLOduration=4.131748371 podStartE2EDuration="23.108776965s" totalImagesPullingTime="18.977028594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:58:59.108679197 +0000 UTC m=+23.842339346" watchObservedRunningTime="2026-07-15 04:58:59.108776965 +0000 UTC m=+23.842437114" Jul 15 04:58:59.396393 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.396365 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 04:58:59.720942 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.720793 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T04:58:59.396384767Z","UUID":"25bba522-3872-44d3-b70e-9069d738c140","Handler":null,"Name":"","Endpoint":""} Jul 15 04:58:59.722552 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.722516 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 04:58:59.722689 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.722561 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 04:58:59.789135 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.789097 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:58:59.789336 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.789098 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:58:59.789336 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:59.789239 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:58:59.789336 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:58:59.789104 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:58:59.789336 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:59.789325 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:58:59.789514 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:58:59.789420 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:59:00.020557 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:00.020442 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4lwws" event={"ID":"bdab8570-f78a-493b-ab3e-6f208aae11af","Type":"ContainerStarted","Data":"abbfcb7540cdd0f0ed967a29c98956979dba399ae371df13bf616205f3153c04"} Jul 15 04:59:00.022699 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:00.022630 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" event={"ID":"3ee8a287-ef2c-4cea-898a-a5d8beb7907a","Type":"ContainerStarted","Data":"e35c3841fb6339e1dcf84fba7c0ccfc9d0d0c61203ca084441f492436b551ea6"} Jul 15 04:59:00.034716 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:00.034659 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4lwws" podStartSLOduration=5.065276267 podStartE2EDuration="24.034638917s" totalImagesPullingTime="18.96936265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:59:00.034209715 +0000 UTC m=+24.767869863" watchObservedRunningTime="2026-07-15 04:59:00.034638917 +0000 UTC m=+24.768299067" Jul 15 04:59:01.031751 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:01.031534 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 04:59:01.032205 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:01.032180 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"e0b33c0b43fe986b68894010fe00ac3657731777c4225fa8279a8026df9d4a18"} Jul 15 04:59:01.790004 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:01.789964 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:01.790004 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:01.789997 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:01.790356 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:01.789964 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:59:01.790356 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:01.790104 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:59:01.790356 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:01.790187 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:59:01.790356 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:01.790308 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:59:02.037863 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:02.037819 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" event={"ID":"3ee8a287-ef2c-4cea-898a-a5d8beb7907a","Type":"ContainerStarted","Data":"69d3dcc90eb58571ad40385d3a200d07fd3e50bb4cbdaff5bc3158502685b044"} Jul 15 04:59:02.056900 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:02.056793 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h5lnw" podStartSLOduration=4.412589677 podStartE2EDuration="26.056776665s" totalImagesPullingTime="21.644186988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:59:02.05560089 +0000 UTC m=+26.789261040" watchObservedRunningTime="2026-07-15 04:59:02.056776665 +0000 UTC m=+26.790436854" Jul 15 04:59:03.554523 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:03.554279 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-krghk" Jul 15 04:59:03.555370 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:03.554900 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-krghk" Jul 15 04:59:03.788981 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:03.788948 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:03.789171 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:03.788948 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:59:03.789171 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:03.789066 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:59:03.789171 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:03.789147 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:59:03.789171 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:03.788948 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:03.789314 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:03.789216 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:59:04.043476 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.043443 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb3b9f40-853a-4bba-aee5-05f07618156a" containerID="dde6bc818cd760b44ab3dcd375fe6ac50ecbf995983892ed1d0fd1ef396e9d96" exitCode=0 Jul 15 04:59:04.043675 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.043510 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" event={"ID":"fb3b9f40-853a-4bba-aee5-05f07618156a","Type":"ContainerDied","Data":"dde6bc818cd760b44ab3dcd375fe6ac50ecbf995983892ed1d0fd1ef396e9d96"} Jul 15 04:59:04.047036 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.047017 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 04:59:04.047425 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.047402 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"c58c6c5d05e4947c8a970760d89ff854752e110f9e3a0dac6f2717b06d445ead"} Jul 15 04:59:04.047516 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.047483 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-krghk" Jul 15 04:59:04.047714 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.047694 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:59:04.047883 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.047866 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:59:04.047957 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.047919 2555 scope.go:117] "RemoveContainer" containerID="7f2e379ca334ad09cd4b539aa8584b0a88a879df4a6cfe2bedc2e5a95b935242" Jul 15 04:59:04.048095 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.048078 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-krghk" Jul 15 04:59:04.064939 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.064910 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:59:04.065538 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:04.065515 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:59:05.032857 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.032822 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rskgr"] Jul 15 04:59:05.033326 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.032965 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:05.033326 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:05.033063 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:59:05.036177 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.036151 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-28pt6"] Jul 15 04:59:05.036300 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.036258 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:05.036358 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:05.036340 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:59:05.045979 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.045948 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f45b8"] Jul 15 04:59:05.046128 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.046079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:59:05.046214 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:05.046192 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:59:05.056884 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.056861 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 04:59:05.057377 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.057343 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" event={"ID":"20fc919f-3fd8-4273-8254-a7843def7714","Type":"ContainerStarted","Data":"d8f160a415c7e6931d866a71e1465fb97471e3c70ae756aaa784d848ddbda487"} Jul 15 04:59:05.057487 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.057388 2555 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 15 04:59:05.086805 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.086617 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" podStartSLOduration=11.028330249 podStartE2EDuration="30.086596677s" totalImagesPullingTime="19.058266428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:59:05.086025111 +0000 UTC m=+29.819685256" watchObservedRunningTime="2026-07-15 04:59:05.086596677 +0000 UTC m=+29.820256817" Jul 15 04:59:05.527603 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:05.527560 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:59:06.061853 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:06.061809 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb3b9f40-853a-4bba-aee5-05f07618156a" containerID="19e3ca904473120ebe32319f52ff41faa181fbc89ca6745df7c5453a41f7057d" exitCode=0 Jul 15 04:59:06.062240 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:06.061879 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" event={"ID":"fb3b9f40-853a-4bba-aee5-05f07618156a","Type":"ContainerDied","Data":"19e3ca904473120ebe32319f52ff41faa181fbc89ca6745df7c5453a41f7057d"} Jul 15 04:59:06.789896 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:06.789659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:59:06.790060 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:06.789660 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:06.790060 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:06.789943 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:59:06.790060 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:06.790032 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:59:06.790159 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:06.789718 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:06.790159 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:06.790141 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:59:08.068606 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:08.068566 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb3b9f40-853a-4bba-aee5-05f07618156a" containerID="0e155aff68b132b08e3a767e51b9178fff0c1539a5b16b0cd72f43c15541c873" exitCode=0 Jul 15 04:59:08.069341 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:08.068637 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" event={"ID":"fb3b9f40-853a-4bba-aee5-05f07618156a","Type":"ContainerDied","Data":"0e155aff68b132b08e3a767e51b9178fff0c1539a5b16b0cd72f43c15541c873"} Jul 15 04:59:08.789269 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:08.789230 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:59:08.789446 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:08.789230 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:08.789446 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:08.789369 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 04:59:08.789446 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:08.789245 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:08.789567 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:08.789411 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rskgr" podUID="7baa6030-ed2c-47aa-8eed-a59dfa2d1f33" Jul 15 04:59:08.789567 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:08.789529 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-28pt6" podUID="fdf81bc9-ded5-40e1-a816-ad48da30874a" Jul 15 04:59:09.529243 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:09.529210 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:09.529753 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:09.529271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:59:09.529753 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:09.529363 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:59:09.529753 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:09.529419 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:41.529403919 +0000 UTC m=+66.263064047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 04:59:09.529753 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:09.529363 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 04:59:09.529753 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:09.529484 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret podName:fdf81bc9-ded5-40e1-a816-ad48da30874a nodeName:}" failed. No retries permitted until 2026-07-15 04:59:41.529472767 +0000 UTC m=+66.263132899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret") pod "global-pull-secret-syncer-28pt6" (UID: "fdf81bc9-ded5-40e1-a816-ad48da30874a") : object "kube-system"/"original-pull-secret" not registered Jul 15 04:59:09.630288 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:09.630245 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:09.630468 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:09.630437 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 04:59:09.630468 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:09.630462 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 04:59:09.630587 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:09.630476 2555 projected.go:196] Error preparing data for projected volume kube-api-access-t5rlm for pod openshift-network-diagnostics/network-check-target-rskgr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:59:09.630587 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:09.630548 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm podName:7baa6030-ed2c-47aa-8eed-a59dfa2d1f33 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:41.630527594 +0000 UTC m=+66.364187740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t5rlm" (UniqueName: "kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm") pod "network-check-target-rskgr" (UID: "7baa6030-ed2c-47aa-8eed-a59dfa2d1f33") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 04:59:10.579179 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.579144 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-241.ec2.internal" event="NodeReady" Jul 15 04:59:10.579643 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.579297 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 04:59:10.633326 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.633236 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f887b58fb-999ng"] Jul 15 04:59:10.635711 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.635687 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wkdl8"] Jul 15 04:59:10.635865 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.635845 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.637704 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.637682 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:10.638324 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.638305 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 04:59:10.638554 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.638537 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 04:59:10.638625 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.638577 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 04:59:10.638625 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.638617 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8tsq2\"" Jul 15 04:59:10.643329 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.643298 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 04:59:10.643943 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.643347 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 04:59:10.644141 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.643366 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-56hmx\"" Jul 15 04:59:10.645814 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.645794 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b9v4z"] Jul 15 04:59:10.647321 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.647301 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 04:59:10.648956 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.648938 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d8l9m"] Jul 15 04:59:10.649099 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.649083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.651543 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.651514 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 04:59:10.651659 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.651533 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 04:59:10.651866 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.651839 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wkdl8"] Jul 15 04:59:10.652099 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.652080 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d8l9m" Jul 15 04:59:10.652225 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.652203 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crtzp\"" Jul 15 04:59:10.656467 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.656361 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-22jq7\"" Jul 15 04:59:10.657066 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.656879 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 04:59:10.657066 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.656958 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 04:59:10.657981 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.657961 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b9v4z"] Jul 15 04:59:10.659108 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.659090 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 04:59:10.659862 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.659839 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d8l9m"] Jul 15 04:59:10.664262 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.663572 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f887b58fb-999ng"] Jul 15 04:59:10.738216 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738176 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mrsb\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-kube-api-access-2mrsb\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.738216 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738220 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/921e67df-7091-41fa-85ba-262de34c443c-tmp-dir\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.738476 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738252 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02-cert\") pod \"ingress-canary-d8l9m\" (UID: \"0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02\") " pod="openshift-ingress-canary/ingress-canary-d8l9m" Jul 15 04:59:10.738476 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738273 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-installation-pull-secrets\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.738476 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738322 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.738476 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/921e67df-7091-41fa-85ba-262de34c443c-config-volume\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.738476 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-bound-sa-token\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.738476 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738473 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72fgv\" (UniqueName: \"kubernetes.io/projected/921e67df-7091-41fa-85ba-262de34c443c-kube-api-access-72fgv\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.738807 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.738807 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738535 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmh9v\" (UniqueName: \"kubernetes.io/projected/0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02-kube-api-access-fmh9v\") pod \"ingress-canary-d8l9m\" (UID: \"0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02\") " pod="openshift-ingress-canary/ingress-canary-d8l9m" Jul 15 04:59:10.738807 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-ca-trust-extracted\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.738807 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738611 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-trusted-ca\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.738807 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738645 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e4e433e-4e90-469b-9119-bbb2a87e368d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:10.738807 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:10.738807 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-image-registry-private-configuration\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.738807 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.738772 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-certificates\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.789091 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.789037 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:10.789091 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.789070 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:59:10.789321 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.789248 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:10.793166 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.793130 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 04:59:10.793314 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.793268 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 04:59:10.793382 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.793328 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 04:59:10.793661 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.793640 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 04:59:10.793805 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.793777 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9bt4r\"" Jul 15 04:59:10.793877 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.793860 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lb4wr\"" Jul 15 04:59:10.839642 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839610 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-trusted-ca\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.839642 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839645 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e4e433e-4e90-469b-9119-bbb2a87e368d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:10.839890 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:10.839890 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839747 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-image-registry-private-configuration\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.839890 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:10.839783 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:59:10.839890 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839794 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-certificates\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.839890 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839834 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mrsb\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-kube-api-access-2mrsb\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.840109 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:10.839897 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 04:59:11.339840843 +0000 UTC m=+36.073500996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 04:59:10.840109 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839926 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/921e67df-7091-41fa-85ba-262de34c443c-tmp-dir\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.840109 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839958 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02-cert\") pod \"ingress-canary-d8l9m\" (UID: \"0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02\") " pod="openshift-ingress-canary/ingress-canary-d8l9m" Jul 15 04:59:10.840109 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.839981 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-installation-pull-secrets\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.840109 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840031 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.840109 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840069 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/921e67df-7091-41fa-85ba-262de34c443c-config-volume\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.840109 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840097 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-bound-sa-token\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.840432 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840138 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72fgv\" (UniqueName: \"kubernetes.io/projected/921e67df-7091-41fa-85ba-262de34c443c-kube-api-access-72fgv\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.840432 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840169 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.840432 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840196 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmh9v\" (UniqueName: \"kubernetes.io/projected/0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02-kube-api-access-fmh9v\") pod \"ingress-canary-d8l9m\" (UID: \"0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02\") " pod="openshift-ingress-canary/ingress-canary-d8l9m" Jul 15 04:59:10.840432 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840220 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-ca-trust-extracted\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.840628 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840472 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e4e433e-4e90-469b-9119-bbb2a87e368d-nginx-conf\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:10.840628 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840506 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-certificates\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.840628 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840537 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/921e67df-7091-41fa-85ba-262de34c443c-tmp-dir\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.840628 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.840553 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-ca-trust-extracted\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.840628 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:10.840604 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:59:10.840628 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:10.840618 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 04:59:10.840922 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:10.840688 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:11.340662525 +0000 UTC m=+36.074322671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 04:59:10.840922 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:10.840791 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:59:10.840922 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:10.840827 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 04:59:11.340815538 +0000 UTC m=+36.074475675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 04:59:10.841352 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.841154 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/921e67df-7091-41fa-85ba-262de34c443c-config-volume\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.841439 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.841324 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-trusted-ca\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.844848 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.844778 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-image-registry-private-configuration\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.844848 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.844778 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-installation-pull-secrets\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.844848 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.844788 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02-cert\") pod \"ingress-canary-d8l9m\" (UID: \"0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02\") " pod="openshift-ingress-canary/ingress-canary-d8l9m" Jul 15 04:59:10.849109 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.849059 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mrsb\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-kube-api-access-2mrsb\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.849806 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.849783 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-bound-sa-token\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:10.850012 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.849990 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72fgv\" (UniqueName: \"kubernetes.io/projected/921e67df-7091-41fa-85ba-262de34c443c-kube-api-access-72fgv\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:10.850220 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.850189 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmh9v\" (UniqueName: \"kubernetes.io/projected/0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02-kube-api-access-fmh9v\") pod \"ingress-canary-d8l9m\" (UID: \"0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02\") " pod="openshift-ingress-canary/ingress-canary-d8l9m" Jul 15 04:59:10.979567 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:10.979433 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d8l9m" Jul 15 04:59:11.346559 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:11.346518 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:11.346757 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:11.346602 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:11.346757 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:11.346705 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:59:11.346757 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:11.346744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:11.346905 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:11.346781 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 04:59:12.346764044 +0000 UTC m=+37.080424172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 04:59:11.346905 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:11.346705 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:59:11.346905 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:11.346820 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:59:11.346905 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:11.346832 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 04:59:11.346905 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:11.346890 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 04:59:12.346863249 +0000 UTC m=+37.080523391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 04:59:11.347106 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:11.346912 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:12.346901556 +0000 UTC m=+37.080561683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 04:59:12.281850 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:12.281816 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d8l9m"] Jul 15 04:59:12.285608 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:59:12.285577 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af4d1b5_0ed7_4d63_ab89_40bb98cb8c02.slice/crio-4427a3105d61d67b17481b8232a7e1fa8112f5e98220aa25d5de75b252945214 WatchSource:0}: Error finding container 4427a3105d61d67b17481b8232a7e1fa8112f5e98220aa25d5de75b252945214: Status 404 returned error can't find the container with id 4427a3105d61d67b17481b8232a7e1fa8112f5e98220aa25d5de75b252945214 Jul 15 04:59:12.357563 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:12.357530 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:12.357717 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:12.357577 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:12.357717 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:12.357631 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:12.357717 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:12.357686 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:59:12.357717 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:12.357707 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 04:59:12.357717 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:12.357763 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:59:12.358303 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:12.357775 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:59:12.358303 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:12.357786 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:14.357765332 +0000 UTC m=+39.091425476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 04:59:12.358303 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:12.357847 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 04:59:14.357829076 +0000 UTC m=+39.091489217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 04:59:12.358303 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:12.357863 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 04:59:14.35785374 +0000 UTC m=+39.091513867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 04:59:13.084440 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:13.084408 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb3b9f40-853a-4bba-aee5-05f07618156a" containerID="994bf3e5c0494d12cde532ca52528d0325ac0bed72d5ac102e67d97d04b9fdf7" exitCode=0 Jul 15 04:59:13.084614 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:13.084471 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" event={"ID":"fb3b9f40-853a-4bba-aee5-05f07618156a","Type":"ContainerDied","Data":"994bf3e5c0494d12cde532ca52528d0325ac0bed72d5ac102e67d97d04b9fdf7"} Jul 15 04:59:13.085907 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:13.085880 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d8l9m" event={"ID":"0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02","Type":"ContainerStarted","Data":"4427a3105d61d67b17481b8232a7e1fa8112f5e98220aa25d5de75b252945214"} Jul 15 04:59:14.092916 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:14.092697 2555 generic.go:356] "Generic (PLEG): container finished" podID="fb3b9f40-853a-4bba-aee5-05f07618156a" containerID="4adcedc1632f39d3b130f96f0dc58be63febe7f8ab7ca47d10991cb78c89237b" exitCode=0 Jul 15 04:59:14.093348 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:14.092766 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" event={"ID":"fb3b9f40-853a-4bba-aee5-05f07618156a","Type":"ContainerDied","Data":"4adcedc1632f39d3b130f96f0dc58be63febe7f8ab7ca47d10991cb78c89237b"} Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:14.373908 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:14.374086 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:14.374115 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:14.374161 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 04:59:18.374140525 +0000 UTC m=+43.107800667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:14.374237 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:14.374243 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:14.374304 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 04:59:18.374287193 +0000 UTC m=+43.107947340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:14.374347 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:14.374358 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 04:59:14.376783 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:14.374400 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:18.374387234 +0000 UTC m=+43.108047376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 04:59:15.097817 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:15.097773 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d8l9m" event={"ID":"0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02","Type":"ContainerStarted","Data":"3301085a88ea2524be85efaeb831df28e74789dd4bf6b6bb42db4da1f4dded65"} Jul 15 04:59:15.101809 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:15.101784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" event={"ID":"fb3b9f40-853a-4bba-aee5-05f07618156a","Type":"ContainerStarted","Data":"68b0ac3e5e282013cc2264b1e58e45861bcde27677e137c1054d807f2cd74f83"} Jul 15 04:59:15.112962 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:15.112908 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d8l9m" podStartSLOduration=2.584523619 podStartE2EDuration="5.112892153s" totalImagesPullingTime="2.528368534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:59:15.112123667 +0000 UTC m=+39.845783829" watchObservedRunningTime="2026-07-15 04:59:15.112892153 +0000 UTC m=+39.846552303" Jul 15 04:59:15.132096 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:15.132043 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pk4kz" podStartSLOduration=10.089185491 podStartE2EDuration="39.132023445s" totalImagesPullingTime="29.042837954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:59:15.130348691 +0000 UTC m=+39.864008841" watchObservedRunningTime="2026-07-15 04:59:15.132023445 +0000 UTC m=+39.865683594" Jul 15 04:59:18.406002 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:18.405958 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:18.406017 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:18.406115 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:18.406121 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:18.406143 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:18.406168 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 04:59:26.406155307 +0000 UTC m=+51.139815434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:18.406186 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:26.40617377 +0000 UTC m=+51.139833896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:18.406214 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:18.406290 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:59:18.406447 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:18.406319 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 04:59:26.406312405 +0000 UTC m=+51.139972531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 04:59:26.466882 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:26.466836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:26.466882 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:26.466895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:26.467465 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:26.466950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:26.467465 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:26.467015 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:59:26.467465 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:26.467042 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 04:59:26.467465 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:26.467055 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:59:26.467465 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:26.467055 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:59:26.467465 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:26.467110 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 04:59:42.467088192 +0000 UTC m=+67.200748336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 04:59:26.467465 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:26.467130 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 04:59:42.467119427 +0000 UTC m=+67.200779560 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 04:59:26.467465 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:26.467146 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 04:59:42.467137075 +0000 UTC m=+67.200797205 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 04:59:37.087004 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:37.086974 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ktznd" Jul 15 04:59:41.578529 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.578471 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 04:59:41.579042 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.578584 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:41.581106 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.581082 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 04:59:41.581227 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.581194 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 04:59:41.588786 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:41.588752 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 04:59:41.588934 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:41.588853 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 05:00:45.588830277 +0000 UTC m=+130.322490420 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : secret "metrics-daemon-secret" not found Jul 15 04:59:41.592399 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.592374 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf81bc9-ded5-40e1-a816-ad48da30874a-original-pull-secret\") pod \"global-pull-secret-syncer-28pt6\" (UID: \"fdf81bc9-ded5-40e1-a816-ad48da30874a\") " pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:41.679662 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.679621 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:41.682277 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.682251 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 04:59:41.691893 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.691862 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 04:59:41.703007 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.702975 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5rlm\" (UniqueName: \"kubernetes.io/projected/7baa6030-ed2c-47aa-8eed-a59dfa2d1f33-kube-api-access-t5rlm\") pod \"network-check-target-rskgr\" (UID: \"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33\") " pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:41.713899 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.713867 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-28pt6" Jul 15 04:59:41.839577 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:41.839540 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-28pt6"] Jul 15 04:59:41.843646 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:59:41.843615 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf81bc9_ded5_40e1_a816_ad48da30874a.slice/crio-47bc98bda3d0e51601a520212a548da0edd0cdb66f85ccbc2f3cd9686558fccf WatchSource:0}: Error finding container 47bc98bda3d0e51601a520212a548da0edd0cdb66f85ccbc2f3cd9686558fccf: Status 404 returned error can't find the container with id 47bc98bda3d0e51601a520212a548da0edd0cdb66f85ccbc2f3cd9686558fccf Jul 15 04:59:42.003408 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:42.003383 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lb4wr\"" Jul 15 04:59:42.011137 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:42.011109 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:42.139166 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:42.139134 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rskgr"] Jul 15 04:59:42.142473 ip-10-0-134-241 kubenswrapper[2555]: W0715 04:59:42.142441 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7baa6030_ed2c_47aa_8eed_a59dfa2d1f33.slice/crio-e98c6baaaf1122fa0ab1b8b96483abe2b1038bc0537d381721eeb5d405ae74d5 WatchSource:0}: Error finding container e98c6baaaf1122fa0ab1b8b96483abe2b1038bc0537d381721eeb5d405ae74d5: Status 404 returned error can't find the container with id e98c6baaaf1122fa0ab1b8b96483abe2b1038bc0537d381721eeb5d405ae74d5 Jul 15 04:59:42.167904 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:42.167863 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rskgr" event={"ID":"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33","Type":"ContainerStarted","Data":"e98c6baaaf1122fa0ab1b8b96483abe2b1038bc0537d381721eeb5d405ae74d5"} Jul 15 04:59:42.168890 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:42.168867 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-28pt6" event={"ID":"fdf81bc9-ded5-40e1-a816-ad48da30874a","Type":"ContainerStarted","Data":"47bc98bda3d0e51601a520212a548da0edd0cdb66f85ccbc2f3cd9686558fccf"} Jul 15 04:59:42.486542 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:42.486458 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 04:59:42.486542 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:42.486513 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 04:59:42.486754 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:42.486549 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 04:59:42.486754 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:42.486630 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 04:59:42.486754 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:42.486652 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 04:59:42.486754 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:42.486661 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 04:59:42.486754 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:42.486654 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 04:59:42.486754 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:42.486714 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 05:00:14.486699797 +0000 UTC m=+99.220359941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 04:59:42.486754 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:42.486752 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 05:00:14.486720243 +0000 UTC m=+99.220380394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 04:59:42.487122 ip-10-0-134-241 kubenswrapper[2555]: E0715 04:59:42.486769 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 05:00:14.486760044 +0000 UTC m=+99.220420173 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 04:59:47.184342 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:47.184292 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-28pt6" event={"ID":"fdf81bc9-ded5-40e1-a816-ad48da30874a","Type":"ContainerStarted","Data":"6d64a04a2f788ce0e6f1c5905623fdfe2697fa99ae35aa7306d02918e5fe7b72"} Jul 15 04:59:47.185820 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:47.185796 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rskgr" event={"ID":"7baa6030-ed2c-47aa-8eed-a59dfa2d1f33","Type":"ContainerStarted","Data":"2ff3cb4da62e377d1772837ce4cd839cbc8793ef3d7dc79fb026bb4d54d0d11a"} Jul 15 04:59:47.185937 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:47.185921 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 04:59:47.200098 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:47.200047 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-28pt6" podStartSLOduration=66.361221602 podStartE2EDuration="1m11.200030831s" totalImagesPullingTime="4.838809229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:59:47.199333274 +0000 UTC m=+71.932993425" watchObservedRunningTime="2026-07-15 04:59:47.200030831 +0000 UTC m=+71.933690958" Jul 15 04:59:47.212629 ip-10-0-134-241 kubenswrapper[2555]: I0715 04:59:47.212521 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rskgr" podStartSLOduration=66.675017515 podStartE2EDuration="1m11.212503465s" totalImagesPullingTime="4.53748595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 04:59:47.212162112 +0000 UTC m=+71.945822261" watchObservedRunningTime="2026-07-15 04:59:47.212503465 +0000 UTC m=+71.946163593" Jul 15 05:00:14.519691 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:00:14.519556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 05:00:14.519691 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:00:14.519617 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 05:00:14.520172 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:00:14.519791 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:00:14.520172 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:14.519790 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 05:00:14.520172 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:14.519873 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 05:00:14.520172 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:14.519880 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 05:00:14.520172 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:14.519886 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 05:00:14.520172 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:14.519922 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 05:01:18.519900915 +0000 UTC m=+163.253561065 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 05:00:14.520172 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:14.519940 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 05:01:18.519931282 +0000 UTC m=+163.253591421 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 05:00:14.520172 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:14.519951 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 05:01:18.519945814 +0000 UTC m=+163.253605941 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 05:00:18.190511 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:00:18.190473 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rskgr" Jul 15 05:00:45.660926 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:00:45.660867 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 05:00:45.661430 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:45.661029 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 05:00:45.661430 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:00:45.661100 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 05:02:47.661081485 +0000 UTC m=+252.394741628 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : secret "metrics-daemon-secret" not found Jul 15 05:01:13.652376 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:13.652325 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" podUID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" Jul 15 05:01:13.662414 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:13.662370 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" podUID="8e4e433e-4e90-469b-9119-bbb2a87e368d" Jul 15 05:01:13.672563 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:13.672530 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b9v4z" podUID="921e67df-7091-41fa-85ba-262de34c443c" Jul 15 05:01:13.807817 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:13.807774 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 05:01:14.392027 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:01:14.391994 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 05:01:14.392027 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:01:14.392026 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:01:14.392230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:01:14.392146 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9v4z" Jul 15 05:01:18.587223 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:01:18.587179 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:01:18.587238 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:01:18.587283 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:18.587336 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:18.587390 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:18.587404 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert podName:8e4e433e-4e90-469b-9119-bbb2a87e368d nodeName:}" failed. No retries permitted until 2026-07-15 05:03:20.587389005 +0000 UTC m=+285.321049131 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-wkdl8" (UID: "8e4e433e-4e90-469b-9119-bbb2a87e368d") : secret "networking-console-plugin-cert" not found Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:18.587405 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f887b58fb-999ng: secret "image-registry-tls" not found Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:18.587434 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls podName:7e4495d1-9d00-4adf-8c0e-bd844ad4e459 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:20.587427496 +0000 UTC m=+285.321087623 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls") pod "image-registry-5f887b58fb-999ng" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459") : secret "image-registry-tls" not found Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:18.587390 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 05:01:18.587633 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:01:18.587455 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls podName:921e67df-7091-41fa-85ba-262de34c443c nodeName:}" failed. No retries permitted until 2026-07-15 05:03:20.587450767 +0000 UTC m=+285.321110895 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls") pod "dns-default-b9v4z" (UID: "921e67df-7091-41fa-85ba-262de34c443c") : secret "dns-default-metrics-tls" not found Jul 15 05:01:25.790484 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:01:25.790447 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 05:02:47.724977 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:02:47.724922 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 05:02:47.725486 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:02:47.725078 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 15 05:02:47.725486 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:02:47.725158 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs podName:8d8d7341-69a1-4be5-b75c-ad4079b82ca6 nodeName:}" failed. No retries permitted until 2026-07-15 05:04:49.725138712 +0000 UTC m=+374.458798850 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs") pod "network-metrics-daemon-f45b8" (UID: "8d8d7341-69a1-4be5-b75c-ad4079b82ca6") : secret "metrics-daemon-secret" not found Jul 15 05:03:02.573894 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.573806 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-xvdnd"] Jul 15 05:03:02.575788 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.575762 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6dcbcd97b-tsqv2"] Jul 15 05:03:02.576052 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.575889 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.577458 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.577435 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8"] Jul 15 05:03:02.577626 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.577564 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.578136 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.578120 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 05:03:02.579151 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.579135 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8" Jul 15 05:03:02.581226 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581209 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 05:03:02.581337 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581262 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 05:03:02.581337 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581262 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 05:03:02.581459 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581225 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 05:03:02.581740 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581701 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 05:03:02.581740 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581712 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 05:03:02.581894 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581759 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 05:03:02.581894 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581713 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5ql24\"" Jul 15 05:03:02.581894 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581768 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 05:03:02.581894 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.581806 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 05:03:02.582250 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.582228 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9ggjd\"" Jul 15 05:03:02.582250 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.582246 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pnpp7\"" Jul 15 05:03:02.588826 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.588806 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8"] Jul 15 05:03:02.589355 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.589283 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 05:03:02.597552 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.597525 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xvdnd"] Jul 15 05:03:02.599912 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.599752 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dcbcd97b-tsqv2"] Jul 15 05:03:02.634700 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634667 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1884a849-4e3e-4e1e-919f-56eee0a8feb3-config\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.634700 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634705 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-default-certificate\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.634936 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9pq2\" (UniqueName: \"kubernetes.io/projected/1884a849-4e3e-4e1e-919f-56eee0a8feb3-kube-api-access-z9pq2\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.634936 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.634936 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1884a849-4e3e-4e1e-919f-56eee0a8feb3-trusted-ca\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.634936 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634866 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1884a849-4e3e-4e1e-919f-56eee0a8feb3-serving-cert\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.634936 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634894 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4w52\" (UniqueName: \"kubernetes.io/projected/173e78ca-cb4d-4710-a157-d3b0920ec374-kube-api-access-q4w52\") pod \"network-check-source-869dcfcdcd-nlnw8\" (UID: \"173e78ca-cb4d-4710-a157-d3b0920ec374\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8" Jul 15 05:03:02.634936 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcc9d\" (UniqueName: \"kubernetes.io/projected/daaf9555-260f-47d0-8f19-144baa1c99c3-kube-api-access-hcc9d\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.635112 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-stats-auth\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.635112 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.634967 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.677231 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.677193 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls"] Jul 15 05:03:02.679287 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.679270 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq"] Jul 15 05:03:02.679409 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.679393 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls" Jul 15 05:03:02.681383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.681361 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97"] Jul 15 05:03:02.681518 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.681461 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 05:03:02.681518 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.681483 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:02.681643 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.681554 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 05:03:02.681929 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.681913 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ftgxd\"" Jul 15 05:03:02.683635 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.683620 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.684138 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.684120 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 05:03:02.684298 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.684258 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 05:03:02.684376 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.684357 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gx96h\"" Jul 15 05:03:02.684543 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.684530 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 05:03:02.686476 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.686453 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 05:03:02.686579 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.686493 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 05:03:02.687248 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.687077 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 05:03:02.687248 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.687131 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 05:03:02.687248 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.687134 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-chftw\"" Jul 15 05:03:02.694962 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.694936 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq"] Jul 15 05:03:02.696049 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.696028 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls"] Jul 15 05:03:02.696798 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.696781 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97"] Jul 15 05:03:02.735423 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735385 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f997f522-722e-467c-84d1-5891c9bbd12c-config\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.735630 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4w52\" (UniqueName: \"kubernetes.io/projected/173e78ca-cb4d-4710-a157-d3b0920ec374-kube-api-access-q4w52\") pod \"network-check-source-869dcfcdcd-nlnw8\" (UID: \"173e78ca-cb4d-4710-a157-d3b0920ec374\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8" Jul 15 05:03:02.735630 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f997f522-722e-467c-84d1-5891c9bbd12c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.735630 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735543 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-stats-auth\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.735630 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735577 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9shv\" (UniqueName: \"kubernetes.io/projected/4fbbe655-9450-4d73-82de-359127e04d68-kube-api-access-j9shv\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:02.735630 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735624 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.735929 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpwg2\" (UniqueName: \"kubernetes.io/projected/f997f522-722e-467c-84d1-5891c9bbd12c-kube-api-access-mpwg2\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.735929 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.735929 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:02.735929 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1884a849-4e3e-4e1e-919f-56eee0a8feb3-serving-cert\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.735929 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:02.735786 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:03.235762234 +0000 UTC m=+267.969422375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : configmap references non-existent config key: service-ca.crt Jul 15 05:03:02.735929 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:02.735827 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 05:03:02.735929 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcc9d\" (UniqueName: \"kubernetes.io/projected/daaf9555-260f-47d0-8f19-144baa1c99c3-kube-api-access-hcc9d\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.735929 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:02.735894 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:03.235876187 +0000 UTC m=+267.969536328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : secret "router-metrics-certs-default" not found Jul 15 05:03:02.736339 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735931 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22jcw\" (UniqueName: \"kubernetes.io/projected/0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61-kube-api-access-22jcw\") pod \"volume-data-source-validator-78495597f6-7gzls\" (UID: \"0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls" Jul 15 05:03:02.736339 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.735981 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1884a849-4e3e-4e1e-919f-56eee0a8feb3-config\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.736339 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.736012 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-default-certificate\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.736339 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.736052 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1884a849-4e3e-4e1e-919f-56eee0a8feb3-trusted-ca\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.736339 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.736094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9pq2\" (UniqueName: \"kubernetes.io/projected/1884a849-4e3e-4e1e-919f-56eee0a8feb3-kube-api-access-z9pq2\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.736743 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.736696 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1884a849-4e3e-4e1e-919f-56eee0a8feb3-config\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.736951 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.736933 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1884a849-4e3e-4e1e-919f-56eee0a8feb3-trusted-ca\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.738269 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.738248 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-stats-auth\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.738269 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.738259 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1884a849-4e3e-4e1e-919f-56eee0a8feb3-serving-cert\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.738390 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.738335 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-default-certificate\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.743518 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.743494 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4w52\" (UniqueName: \"kubernetes.io/projected/173e78ca-cb4d-4710-a157-d3b0920ec374-kube-api-access-q4w52\") pod \"network-check-source-869dcfcdcd-nlnw8\" (UID: \"173e78ca-cb4d-4710-a157-d3b0920ec374\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8" Jul 15 05:03:02.743792 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.743770 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcc9d\" (UniqueName: \"kubernetes.io/projected/daaf9555-260f-47d0-8f19-144baa1c99c3-kube-api-access-hcc9d\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:02.743932 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.743915 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9pq2\" (UniqueName: \"kubernetes.io/projected/1884a849-4e3e-4e1e-919f-56eee0a8feb3-kube-api-access-z9pq2\") pod \"console-operator-7866497494-xvdnd\" (UID: \"1884a849-4e3e-4e1e-919f-56eee0a8feb3\") " pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.758315 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.758286 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq"] Jul 15 05:03:02.760768 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.760751 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.764044 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.764009 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 05:03:02.764044 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.764022 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 05:03:02.764233 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.764053 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mvp4j\"" Jul 15 05:03:02.764233 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.764023 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 05:03:02.764233 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.764029 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 05:03:02.770175 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.770149 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq"] Jul 15 05:03:02.837340 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837300 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9shv\" (UniqueName: \"kubernetes.io/projected/4fbbe655-9450-4d73-82de-359127e04d68-kube-api-access-j9shv\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:02.837340 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.837590 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837375 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpwg2\" (UniqueName: \"kubernetes.io/projected/f997f522-722e-467c-84d1-5891c9bbd12c-kube-api-access-mpwg2\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.837590 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837438 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:02.837590 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837485 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.837590 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:02.837522 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 05:03:02.837590 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837528 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22jcw\" (UniqueName: \"kubernetes.io/projected/0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61-kube-api-access-22jcw\") pod \"volume-data-source-validator-78495597f6-7gzls\" (UID: \"0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls" Jul 15 05:03:02.837590 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:02.837586 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls podName:4fbbe655-9450-4d73-82de-359127e04d68 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:03.33756683 +0000 UTC m=+268.071226974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls") pod "cluster-samples-operator-65db858894-pcllq" (UID: "4fbbe655-9450-4d73-82de-359127e04d68") : secret "samples-operator-tls" not found Jul 15 05:03:02.837907 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837602 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f997f522-722e-467c-84d1-5891c9bbd12c-config\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.837907 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f997f522-722e-467c-84d1-5891c9bbd12c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.837907 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.837656 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjgwt\" (UniqueName: \"kubernetes.io/projected/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-kube-api-access-rjgwt\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.838175 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.838156 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f997f522-722e-467c-84d1-5891c9bbd12c-config\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.839964 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.839943 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f997f522-722e-467c-84d1-5891c9bbd12c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.847872 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.847846 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpwg2\" (UniqueName: \"kubernetes.io/projected/f997f522-722e-467c-84d1-5891c9bbd12c-kube-api-access-mpwg2\") pod \"service-ca-operator-7695fc6c8c-b7h97\" (UID: \"f997f522-722e-467c-84d1-5891c9bbd12c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:02.848033 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.847948 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22jcw\" (UniqueName: \"kubernetes.io/projected/0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61-kube-api-access-22jcw\") pod \"volume-data-source-validator-78495597f6-7gzls\" (UID: \"0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls" Jul 15 05:03:02.848033 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.847948 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9shv\" (UniqueName: \"kubernetes.io/projected/4fbbe655-9450-4d73-82de-359127e04d68-kube-api-access-j9shv\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:02.886141 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.886096 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:02.902365 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.902333 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8" Jul 15 05:03:02.938579 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.938540 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjgwt\" (UniqueName: \"kubernetes.io/projected/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-kube-api-access-rjgwt\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.938788 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.938608 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.940838 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.939177 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.940838 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.939911 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.942044 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.942018 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.947367 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.947340 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjgwt\" (UniqueName: \"kubernetes.io/projected/9d2edac7-0629-49c4-ab63-4e3ab3fa3a34-kube-api-access-rjgwt\") pod \"kube-storage-version-migrator-operator-799cb7f958-9w7hq\" (UID: \"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:02.990488 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:02.990452 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls" Jul 15 05:03:03.003933 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.003902 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" Jul 15 05:03:03.026232 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.026198 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xvdnd"] Jul 15 05:03:03.029948 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:03.029920 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1884a849_4e3e_4e1e_919f_56eee0a8feb3.slice/crio-eb97d6cabd27b81c42d4a86a6caaa4ed490f80ffd393e2fdcbab7f2d8fd2f1f8 WatchSource:0}: Error finding container eb97d6cabd27b81c42d4a86a6caaa4ed490f80ffd393e2fdcbab7f2d8fd2f1f8: Status 404 returned error can't find the container with id eb97d6cabd27b81c42d4a86a6caaa4ed490f80ffd393e2fdcbab7f2d8fd2f1f8 Jul 15 05:03:03.043332 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.043301 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8"] Jul 15 05:03:03.047130 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:03.047097 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173e78ca_cb4d_4710_a157_d3b0920ec374.slice/crio-bca19e8b7e79354e56825e653b63b3ed33634dcc81c9afea863014996a26bcb6 WatchSource:0}: Error finding container bca19e8b7e79354e56825e653b63b3ed33634dcc81c9afea863014996a26bcb6: Status 404 returned error can't find the container with id bca19e8b7e79354e56825e653b63b3ed33634dcc81c9afea863014996a26bcb6 Jul 15 05:03:03.070596 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.070551 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" Jul 15 05:03:03.140053 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.139976 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls"] Jul 15 05:03:03.145250 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:03.145182 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d38ab4c_3d90_482e_bfca_b2c4ee1f5b61.slice/crio-588d8f5b7a000c178136656f4a870398b5e7b8fedcbfc0454d88bd55fd82afa2 WatchSource:0}: Error finding container 588d8f5b7a000c178136656f4a870398b5e7b8fedcbfc0454d88bd55fd82afa2: Status 404 returned error can't find the container with id 588d8f5b7a000c178136656f4a870398b5e7b8fedcbfc0454d88bd55fd82afa2 Jul 15 05:03:03.162792 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.162715 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97"] Jul 15 05:03:03.166534 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:03.166503 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf997f522_722e_467c_84d1_5891c9bbd12c.slice/crio-1d0a6ea4daaabb0c5a999f79eea09c330c6f5fc6eb1bda72604705340aa3708e WatchSource:0}: Error finding container 1d0a6ea4daaabb0c5a999f79eea09c330c6f5fc6eb1bda72604705340aa3708e: Status 404 returned error can't find the container with id 1d0a6ea4daaabb0c5a999f79eea09c330c6f5fc6eb1bda72604705340aa3708e Jul 15 05:03:03.224449 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.224410 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq"] Jul 15 05:03:03.228202 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:03.228174 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2edac7_0629_49c4_ab63_4e3ab3fa3a34.slice/crio-6ad38ff0f2ba4e57fe28ba4725e99cb273981860869f64cd21c6d10486f214dc WatchSource:0}: Error finding container 6ad38ff0f2ba4e57fe28ba4725e99cb273981860869f64cd21c6d10486f214dc: Status 404 returned error can't find the container with id 6ad38ff0f2ba4e57fe28ba4725e99cb273981860869f64cd21c6d10486f214dc Jul 15 05:03:03.243439 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.243401 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:03.243619 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.243447 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:03.243619 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:03.243583 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 05:03:03.243619 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:03.243597 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:04.243574746 +0000 UTC m=+268.977234894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : configmap references non-existent config key: service-ca.crt Jul 15 05:03:03.243800 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:03.243628 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:04.243616468 +0000 UTC m=+268.977276595 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : secret "router-metrics-certs-default" not found Jul 15 05:03:03.344693 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.344648 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:03.344895 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:03.344821 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 05:03:03.344895 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:03.344886 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls podName:4fbbe655-9450-4d73-82de-359127e04d68 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:04.344868473 +0000 UTC m=+269.078528614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls") pod "cluster-samples-operator-65db858894-pcllq" (UID: "4fbbe655-9450-4d73-82de-359127e04d68") : secret "samples-operator-tls" not found Jul 15 05:03:03.658999 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.658944 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" event={"ID":"f997f522-722e-467c-84d1-5891c9bbd12c","Type":"ContainerStarted","Data":"1d0a6ea4daaabb0c5a999f79eea09c330c6f5fc6eb1bda72604705340aa3708e"} Jul 15 05:03:03.660482 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.660450 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls" event={"ID":"0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61","Type":"ContainerStarted","Data":"588d8f5b7a000c178136656f4a870398b5e7b8fedcbfc0454d88bd55fd82afa2"} Jul 15 05:03:03.662656 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.662621 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8" event={"ID":"173e78ca-cb4d-4710-a157-d3b0920ec374","Type":"ContainerStarted","Data":"5b5af104a5ab9d60fc0e2a7994945ff7453ae75363e4c6942f82262b9f91336c"} Jul 15 05:03:03.662864 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.662846 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8" event={"ID":"173e78ca-cb4d-4710-a157-d3b0920ec374","Type":"ContainerStarted","Data":"bca19e8b7e79354e56825e653b63b3ed33634dcc81c9afea863014996a26bcb6"} Jul 15 05:03:03.663869 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.663845 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" event={"ID":"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34","Type":"ContainerStarted","Data":"6ad38ff0f2ba4e57fe28ba4725e99cb273981860869f64cd21c6d10486f214dc"} Jul 15 05:03:03.665229 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.665205 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xvdnd" event={"ID":"1884a849-4e3e-4e1e-919f-56eee0a8feb3","Type":"ContainerStarted","Data":"eb97d6cabd27b81c42d4a86a6caaa4ed490f80ffd393e2fdcbab7f2d8fd2f1f8"} Jul 15 05:03:03.678474 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:03.678410 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nlnw8" podStartSLOduration=1.678392268 podStartE2EDuration="1.678392268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:03.67778355 +0000 UTC m=+268.411443702" watchObservedRunningTime="2026-07-15 05:03:03.678392268 +0000 UTC m=+268.412052417" Jul 15 05:03:04.254159 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:04.254104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:04.254363 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:04.254173 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:04.254363 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:04.254343 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 05:03:04.254476 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:04.254405 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:06.254385813 +0000 UTC m=+270.988045946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : secret "router-metrics-certs-default" not found Jul 15 05:03:04.254536 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:04.254482 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:06.254471588 +0000 UTC m=+270.988131720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : configmap references non-existent config key: service-ca.crt Jul 15 05:03:04.355043 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:04.355010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:04.355206 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:04.355187 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 05:03:04.355288 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:04.355266 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls podName:4fbbe655-9450-4d73-82de-359127e04d68 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:06.355243983 +0000 UTC m=+271.088904115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls") pod "cluster-samples-operator-65db858894-pcllq" (UID: "4fbbe655-9450-4d73-82de-359127e04d68") : secret "samples-operator-tls" not found Jul 15 05:03:04.671218 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:04.671164 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls" event={"ID":"0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61","Type":"ContainerStarted","Data":"9c39bc82d7cd6981d084b1045140729aa6263a9daf3e9b3cb06cff883a660359"} Jul 15 05:03:04.686123 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:04.686018 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-7gzls" podStartSLOduration=1.489409625 podStartE2EDuration="2.685995223s" totalImagesPullingTime="1.196585598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:04.685408203 +0000 UTC m=+269.419068352" watchObservedRunningTime="2026-07-15 05:03:04.685995223 +0000 UTC m=+269.419655373" Jul 15 05:03:06.272383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:06.272346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:06.272383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:06.272400 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:06.272900 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:06.272506 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 05:03:06.272900 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:06.272564 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:10.272543198 +0000 UTC m=+275.006203341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : secret "router-metrics-certs-default" not found Jul 15 05:03:06.272900 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:06.272658 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:10.272647226 +0000 UTC m=+275.006307359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : configmap references non-existent config key: service-ca.crt Jul 15 05:03:06.373260 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:06.373217 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:06.373437 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:06.373385 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 05:03:06.373483 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:06.373468 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls podName:4fbbe655-9450-4d73-82de-359127e04d68 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:10.373447857 +0000 UTC m=+275.107107988 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls") pod "cluster-samples-operator-65db858894-pcllq" (UID: "4fbbe655-9450-4d73-82de-359127e04d68") : secret "samples-operator-tls" not found Jul 15 05:03:06.679955 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:06.679916 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" event={"ID":"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34","Type":"ContainerStarted","Data":"5e2b5a7171e3e898b2c5acfba72b8b92723c239a1f805aa7ceaea9d393fd1a65"} Jul 15 05:03:06.681383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:06.681350 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" event={"ID":"f997f522-722e-467c-84d1-5891c9bbd12c","Type":"ContainerStarted","Data":"5e6349fd36951c046230c5cfd87ea88edd424bf9565b2825ecd076bbd5509d21"} Jul 15 05:03:06.697873 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:06.697811 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" podStartSLOduration=2.202896699 podStartE2EDuration="4.69778632s" totalImagesPullingTime="2.494889621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:06.697669677 +0000 UTC m=+271.431329827" watchObservedRunningTime="2026-07-15 05:03:06.69778632 +0000 UTC m=+271.431446464" Jul 15 05:03:08.096817 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.096748 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" podStartSLOduration=3.544623681 podStartE2EDuration="6.096715531s" totalImagesPullingTime="2.55209185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:06.720689518 +0000 UTC m=+271.454349667" watchObservedRunningTime="2026-07-15 05:03:08.096715531 +0000 UTC m=+272.830375699" Jul 15 05:03:08.097423 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.097403 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-frbgm"] Jul 15 05:03:08.100759 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.100714 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.103675 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.103650 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 05:03:08.103820 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.103650 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 05:03:08.103988 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.103973 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 05:03:08.104390 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.104372 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 05:03:08.104473 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.104385 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7zgl9\"" Jul 15 05:03:08.118208 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.118182 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frbgm"] Jul 15 05:03:08.188681 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.188638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n68rh\" (UniqueName: \"kubernetes.io/projected/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-api-access-n68rh\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.188892 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.188708 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-data-volume\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.188892 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.188782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.188892 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.188864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.189034 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.188902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-crio-socket\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.290091 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.290058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n68rh\" (UniqueName: \"kubernetes.io/projected/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-api-access-n68rh\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.290274 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.290120 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-data-volume\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.290274 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.290238 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.290416 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.290321 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.290416 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.290366 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-crio-socket\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.290416 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:08.290368 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 05:03:08.290547 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:08.290437 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:08.790416199 +0000 UTC m=+273.524076327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : configmap "kube-rbac-proxy" not found Jul 15 05:03:08.290547 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:08.290465 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 05:03:08.290547 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.290467 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-crio-socket\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.290547 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.290477 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-data-volume\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.290698 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:08.290566 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:08.790550594 +0000 UTC m=+273.524210730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : secret "insights-runtime-extractor-tls" not found Jul 15 05:03:08.298739 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.298687 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n68rh\" (UniqueName: \"kubernetes.io/projected/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-api-access-n68rh\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.794333 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.794290 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.794528 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:08.794378 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:08.794528 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:08.794437 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 05:03:08.794528 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:08.794470 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 05:03:08.794528 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:08.794524 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:09.794502644 +0000 UTC m=+274.528162788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : configmap "kube-rbac-proxy" not found Jul 15 05:03:08.794761 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:08.794543 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:09.794533531 +0000 UTC m=+274.528193658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : secret "insights-runtime-extractor-tls" not found Jul 15 05:03:09.692978 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:09.692950 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/0.log" Jul 15 05:03:09.693365 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:09.692990 2555 generic.go:356] "Generic (PLEG): container finished" podID="1884a849-4e3e-4e1e-919f-56eee0a8feb3" containerID="fe62e0014349046e72f8f91d8f2fc608e775d6db78066614629782b261cff289" exitCode=255 Jul 15 05:03:09.693365 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:09.693065 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xvdnd" event={"ID":"1884a849-4e3e-4e1e-919f-56eee0a8feb3","Type":"ContainerDied","Data":"fe62e0014349046e72f8f91d8f2fc608e775d6db78066614629782b261cff289"} Jul 15 05:03:09.693365 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:09.693336 2555 scope.go:117] "RemoveContainer" containerID="fe62e0014349046e72f8f91d8f2fc608e775d6db78066614629782b261cff289" Jul 15 05:03:09.805056 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:09.805030 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:09.805170 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:09.805154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:09.805257 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:09.805158 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 05:03:09.805310 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:09.805299 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:11.805283961 +0000 UTC m=+276.538944088 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : configmap "kube-rbac-proxy" not found Jul 15 05:03:09.805362 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:09.805236 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 05:03:09.805436 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:09.805373 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:11.805359744 +0000 UTC m=+276.539019886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : secret "insights-runtime-extractor-tls" not found Jul 15 05:03:10.310713 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.310673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:10.310713 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.310720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:10.310974 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:10.310841 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:18.310824901 +0000 UTC m=+283.044485028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : configmap references non-existent config key: service-ca.crt Jul 15 05:03:10.310974 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:10.310864 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 05:03:10.310974 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:10.310902 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:18.310891409 +0000 UTC m=+283.044551537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : secret "router-metrics-certs-default" not found Jul 15 05:03:10.412064 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.412005 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:10.412230 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:10.412167 2555 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 05:03:10.412293 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:10.412236 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls podName:4fbbe655-9450-4d73-82de-359127e04d68 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:18.412220924 +0000 UTC m=+283.145881050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls") pod "cluster-samples-operator-65db858894-pcllq" (UID: "4fbbe655-9450-4d73-82de-359127e04d68") : secret "samples-operator-tls" not found Jul 15 05:03:10.697977 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.697950 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:03:10.698347 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.698313 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/0.log" Jul 15 05:03:10.698402 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.698344 2555 generic.go:356] "Generic (PLEG): container finished" podID="1884a849-4e3e-4e1e-919f-56eee0a8feb3" containerID="907d86f60527802e28ed3ac8e4949b2fbf037b205c5146584461408a59b07401" exitCode=255 Jul 15 05:03:10.698402 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.698376 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xvdnd" event={"ID":"1884a849-4e3e-4e1e-919f-56eee0a8feb3","Type":"ContainerDied","Data":"907d86f60527802e28ed3ac8e4949b2fbf037b205c5146584461408a59b07401"} Jul 15 05:03:10.698472 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.698447 2555 scope.go:117] "RemoveContainer" containerID="fe62e0014349046e72f8f91d8f2fc608e775d6db78066614629782b261cff289" Jul 15 05:03:10.698699 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:10.698686 2555 scope.go:117] "RemoveContainer" containerID="907d86f60527802e28ed3ac8e4949b2fbf037b205c5146584461408a59b07401" Jul 15 05:03:10.698922 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:10.698899 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xvdnd_openshift-console-operator(1884a849-4e3e-4e1e-919f-56eee0a8feb3)\"" pod="openshift-console-operator/console-operator-7866497494-xvdnd" podUID="1884a849-4e3e-4e1e-919f-56eee0a8feb3" Jul 15 05:03:11.081362 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:11.081286 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xxqhm_3ce77b74-fbf5-4ff1-b59f-e72e96651f95/dns-node-resolver/0.log" Jul 15 05:03:11.705136 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:11.705100 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:03:11.705686 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:11.705586 2555 scope.go:117] "RemoveContainer" containerID="907d86f60527802e28ed3ac8e4949b2fbf037b205c5146584461408a59b07401" Jul 15 05:03:11.706251 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:11.706227 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xvdnd_openshift-console-operator(1884a849-4e3e-4e1e-919f-56eee0a8feb3)\"" pod="openshift-console-operator/console-operator-7866497494-xvdnd" podUID="1884a849-4e3e-4e1e-919f-56eee0a8feb3" Jul 15 05:03:11.826465 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:11.826420 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:11.826640 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:11.826511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:11.826702 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:11.826682 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 05:03:11.826786 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:11.826772 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 05:03:11.826841 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:11.826793 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:15.826772285 +0000 UTC m=+280.560432433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : secret "insights-runtime-extractor-tls" not found Jul 15 05:03:11.826841 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:11.826834 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:15.826816495 +0000 UTC m=+280.560476623 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : configmap "kube-rbac-proxy" not found Jul 15 05:03:11.880588 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:11.880558 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fvlwf_7ab27930-ab90-4b71-b886-177912fc9147/node-ca/0.log" Jul 15 05:03:12.481020 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:12.480988 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d8l9m_0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02/serve-healthcheck-canary/0.log" Jul 15 05:03:12.886821 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:12.886783 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:12.887214 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:12.886844 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:12.887214 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:12.887170 2555 scope.go:117] "RemoveContainer" containerID="907d86f60527802e28ed3ac8e4949b2fbf037b205c5146584461408a59b07401" Jul 15 05:03:12.887337 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:12.887319 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xvdnd_openshift-console-operator(1884a849-4e3e-4e1e-919f-56eee0a8feb3)\"" pod="openshift-console-operator/console-operator-7866497494-xvdnd" podUID="1884a849-4e3e-4e1e-919f-56eee0a8feb3" Jul 15 05:03:13.482513 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:13.482477 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-9w7hq_9d2edac7-0629-49c4-ab63-4e3ab3fa3a34/kube-storage-version-migrator-operator/0.log" Jul 15 05:03:15.860269 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:15.860229 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:15.860635 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:15.860295 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:15.860635 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:15.860349 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 05:03:15.860635 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:15.860406 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 05:03:15.860635 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:15.860415 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:23.860398494 +0000 UTC m=+288.594058621 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : configmap "kube-rbac-proxy" not found Jul 15 05:03:15.860635 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:15.860467 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls podName:4364a2ff-f67b-416d-a4b5-6fcccf00eabd nodeName:}" failed. No retries permitted until 2026-07-15 05:03:23.86043521 +0000 UTC m=+288.594095338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-frbgm" (UID: "4364a2ff-f67b-416d-a4b5-6fcccf00eabd") : secret "insights-runtime-extractor-tls" not found Jul 15 05:03:17.393368 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:17.393303 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b9v4z" podUID="921e67df-7091-41fa-85ba-262de34c443c" Jul 15 05:03:17.393912 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:17.393449 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" podUID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" Jul 15 05:03:17.394010 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:17.393564 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" podUID="8e4e433e-4e90-469b-9119-bbb2a87e368d" Jul 15 05:03:17.723065 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:17.722974 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:03:17.723237 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:17.722975 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9v4z" Jul 15 05:03:17.723237 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:17.722974 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 05:03:18.384302 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:18.384246 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:18.384546 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:18.384391 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:18.384546 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:18.384494 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle podName:daaf9555-260f-47d0-8f19-144baa1c99c3 nodeName:}" failed. No retries permitted until 2026-07-15 05:03:34.384471424 +0000 UTC m=+299.118131556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle") pod "router-default-6dcbcd97b-tsqv2" (UID: "daaf9555-260f-47d0-8f19-144baa1c99c3") : configmap references non-existent config key: service-ca.crt Jul 15 05:03:18.386867 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:18.386847 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daaf9555-260f-47d0-8f19-144baa1c99c3-metrics-certs\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:18.484971 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:18.484932 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:18.487518 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:18.487489 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4fbbe655-9450-4d73-82de-359127e04d68-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-pcllq\" (UID: \"4fbbe655-9450-4d73-82de-359127e04d68\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:18.598017 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:18.597975 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" Jul 15 05:03:18.731278 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:18.731238 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq"] Jul 15 05:03:19.730276 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:19.730231 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" event={"ID":"4fbbe655-9450-4d73-82de-359127e04d68","Type":"ContainerStarted","Data":"be44e7b0e771db0e8dbd707e3810e3711fb877dc7286213ded2eba0713478b2b"} Jul 15 05:03:20.603030 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.602993 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 05:03:20.603192 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.603041 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 05:03:20.603192 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.603075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:03:20.605623 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.605593 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e4e433e-4e90-469b-9119-bbb2a87e368d-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-wkdl8\" (UID: \"8e4e433e-4e90-469b-9119-bbb2a87e368d\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 05:03:20.605623 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.605620 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/921e67df-7091-41fa-85ba-262de34c443c-metrics-tls\") pod \"dns-default-b9v4z\" (UID: \"921e67df-7091-41fa-85ba-262de34c443c\") " pod="openshift-dns/dns-default-b9v4z" Jul 15 05:03:20.605792 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.605717 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"image-registry-5f887b58fb-999ng\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:03:20.726646 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.726557 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8tsq2\"" Jul 15 05:03:20.726646 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.726604 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-56hmx\"" Jul 15 05:03:20.726871 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.726604 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-crtzp\"" Jul 15 05:03:20.733538 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.733515 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9v4z" Jul 15 05:03:20.733991 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.733636 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:03:20.733991 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.733688 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" Jul 15 05:03:20.734575 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.734551 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" event={"ID":"4fbbe655-9450-4d73-82de-359127e04d68","Type":"ContainerStarted","Data":"77e53cbf8ac83dc9626dbaee0b64ff2205ec04746ee43a700b1b99938861fd77"} Jul 15 05:03:20.734637 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.734597 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" event={"ID":"4fbbe655-9450-4d73-82de-359127e04d68","Type":"ContainerStarted","Data":"12f10d67ac969d249084f0bc41b61daf43d41784b780e317e8d3bd601a2d36f9"} Jul 15 05:03:20.751762 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.751699 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-pcllq" podStartSLOduration=17.15979102 podStartE2EDuration="18.751680112s" totalImagesPullingTime="1.591889092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:20.751164423 +0000 UTC m=+285.484824570" watchObservedRunningTime="2026-07-15 05:03:20.751680112 +0000 UTC m=+285.485340263" Jul 15 05:03:20.881159 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:20.881128 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b9v4z"] Jul 15 05:03:20.883924 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:20.883894 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921e67df_7091_41fa_85ba_262de34c443c.slice/crio-993e834d115b70931f0e446411d7acde30af78eb92e91a061f28ad5a54a3b467 WatchSource:0}: Error finding container 993e834d115b70931f0e446411d7acde30af78eb92e91a061f28ad5a54a3b467: Status 404 returned error can't find the container with id 993e834d115b70931f0e446411d7acde30af78eb92e91a061f28ad5a54a3b467 Jul 15 05:03:21.106150 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:21.106121 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-wkdl8"] Jul 15 05:03:21.108585 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:21.108566 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f887b58fb-999ng"] Jul 15 05:03:21.110380 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:21.110356 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4e433e_4e90_469b_9119_bbb2a87e368d.slice/crio-1bfa0f16f3ab232cfb37ceddc70be58775a2186d9ff1bdcaf278a6971251e0d8 WatchSource:0}: Error finding container 1bfa0f16f3ab232cfb37ceddc70be58775a2186d9ff1bdcaf278a6971251e0d8: Status 404 returned error can't find the container with id 1bfa0f16f3ab232cfb37ceddc70be58775a2186d9ff1bdcaf278a6971251e0d8 Jul 15 05:03:21.111236 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:21.111213 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4495d1_9d00_4adf_8c0e_bd844ad4e459.slice/crio-e74823dcf0d5b91dcd2af768680c39cf070ccdd40118f485222e59d7f671af75 WatchSource:0}: Error finding container e74823dcf0d5b91dcd2af768680c39cf070ccdd40118f485222e59d7f671af75: Status 404 returned error can't find the container with id e74823dcf0d5b91dcd2af768680c39cf070ccdd40118f485222e59d7f671af75 Jul 15 05:03:21.739720 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:21.739681 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9v4z" event={"ID":"921e67df-7091-41fa-85ba-262de34c443c","Type":"ContainerStarted","Data":"993e834d115b70931f0e446411d7acde30af78eb92e91a061f28ad5a54a3b467"} Jul 15 05:03:21.741113 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:21.741077 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" event={"ID":"8e4e433e-4e90-469b-9119-bbb2a87e368d","Type":"ContainerStarted","Data":"1bfa0f16f3ab232cfb37ceddc70be58775a2186d9ff1bdcaf278a6971251e0d8"} Jul 15 05:03:21.742768 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:21.742716 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" event={"ID":"7e4495d1-9d00-4adf-8c0e-bd844ad4e459","Type":"ContainerStarted","Data":"3698e91f5ca53f7443547a744a8e0427deb6d8d638a81f078b85379d0bb05ab5"} Jul 15 05:03:21.742902 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:21.742785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" event={"ID":"7e4495d1-9d00-4adf-8c0e-bd844ad4e459","Type":"ContainerStarted","Data":"e74823dcf0d5b91dcd2af768680c39cf070ccdd40118f485222e59d7f671af75"} Jul 15 05:03:21.765069 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:21.765005 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" podStartSLOduration=285.764979612 podStartE2EDuration="4m45.764979612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:21.764423579 +0000 UTC m=+286.498083730" watchObservedRunningTime="2026-07-15 05:03:21.764979612 +0000 UTC m=+286.498639764" Jul 15 05:03:22.748587 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:22.748494 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" event={"ID":"8e4e433e-4e90-469b-9119-bbb2a87e368d","Type":"ContainerStarted","Data":"06c6a75b425c4f51b8f4578f8109ffeb4b4a12df163d6411a4150d5f908b9ee1"} Jul 15 05:03:22.749030 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:22.748794 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:03:22.764910 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:22.764850 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-wkdl8" podStartSLOduration=275.482410953 podStartE2EDuration="4m36.764831927s" totalImagesPullingTime="1.282420974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:22.76335925 +0000 UTC m=+287.497019401" watchObservedRunningTime="2026-07-15 05:03:22.764831927 +0000 UTC m=+287.498492075" Jul 15 05:03:23.754231 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:23.754196 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9v4z" event={"ID":"921e67df-7091-41fa-85ba-262de34c443c","Type":"ContainerStarted","Data":"93db6c360feb965010c1b49f21c64b395d40d4788b920786658c8c5af1ac547a"} Jul 15 05:03:23.754655 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:23.754248 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9v4z" event={"ID":"921e67df-7091-41fa-85ba-262de34c443c","Type":"ContainerStarted","Data":"6d2496d798211207cbc46a45b15893b81e56ce8fe5f4ad65a9747673ce1fbc8b"} Jul 15 05:03:23.770782 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:23.770714 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b9v4z" podStartSLOduration=251.511095433 podStartE2EDuration="4m13.770696132s" totalImagesPullingTime="2.259600699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:23.7692998 +0000 UTC m=+288.502959992" watchObservedRunningTime="2026-07-15 05:03:23.770696132 +0000 UTC m=+288.504356321" Jul 15 05:03:23.932377 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:23.932338 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:23.932537 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:23.932395 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:23.932941 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:23.932913 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:23.934772 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:23.934752 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4364a2ff-f67b-416d-a4b5-6fcccf00eabd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-frbgm\" (UID: \"4364a2ff-f67b-416d-a4b5-6fcccf00eabd\") " pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:24.011032 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:24.010938 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-frbgm" Jul 15 05:03:24.168409 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:24.168365 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-frbgm"] Jul 15 05:03:24.173192 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:24.173165 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4364a2ff_f67b_416d_a4b5_6fcccf00eabd.slice/crio-cdd3f5cd8746efbfa20872fbac59b0ab00f50514e02499ae5ce4b2e3651adca7 WatchSource:0}: Error finding container cdd3f5cd8746efbfa20872fbac59b0ab00f50514e02499ae5ce4b2e3651adca7: Status 404 returned error can't find the container with id cdd3f5cd8746efbfa20872fbac59b0ab00f50514e02499ae5ce4b2e3651adca7 Jul 15 05:03:24.761329 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:24.761208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frbgm" event={"ID":"4364a2ff-f67b-416d-a4b5-6fcccf00eabd","Type":"ContainerStarted","Data":"cdd3f5cd8746efbfa20872fbac59b0ab00f50514e02499ae5ce4b2e3651adca7"} Jul 15 05:03:24.761329 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:24.761279 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b9v4z" Jul 15 05:03:25.791056 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:25.791020 2555 scope.go:117] "RemoveContainer" containerID="907d86f60527802e28ed3ac8e4949b2fbf037b205c5146584461408a59b07401" Jul 15 05:03:28.777619 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:28.777534 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:03:28.778068 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:28.777622 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xvdnd" event={"ID":"1884a849-4e3e-4e1e-919f-56eee0a8feb3","Type":"ContainerStarted","Data":"95580fb2aecf7673ef9181fba78b058ea4ce658ab02722ad4d6e3c0bbe2b52b8"} Jul 15 05:03:28.778068 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:28.777946 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:28.779676 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:28.779650 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frbgm" event={"ID":"4364a2ff-f67b-416d-a4b5-6fcccf00eabd","Type":"ContainerStarted","Data":"d1e33953bcef59a8172f6121743cd9ba9899375603839d05f940ab8d65e4548e"} Jul 15 05:03:28.779804 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:28.779699 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frbgm" event={"ID":"4364a2ff-f67b-416d-a4b5-6fcccf00eabd","Type":"ContainerStarted","Data":"db892f293ef5c05885a0c946b555de7b60391ea25001dc027a20b8ce1dcf5f08"} Jul 15 05:03:28.791190 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:28.791158 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f45b8" podUID="8d8d7341-69a1-4be5-b75c-ad4079b82ca6" Jul 15 05:03:28.794393 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:28.794344 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-xvdnd" podStartSLOduration=20.632851978 podStartE2EDuration="26.794320441s" totalImagesPullingTime="6.161468463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:28.79378021 +0000 UTC m=+293.527440359" watchObservedRunningTime="2026-07-15 05:03:28.794320441 +0000 UTC m=+293.527980582" Jul 15 05:03:29.463566 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:29.463526 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-xvdnd" Jul 15 05:03:31.499964 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.498049 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-xfqj8"] Jul 15 05:03:31.503091 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.502604 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xfqj8" Jul 15 05:03:31.507520 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.507480 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vn49m\"" Jul 15 05:03:31.507892 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.507872 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 05:03:31.508091 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.508059 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 05:03:31.515775 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.515746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xfqj8"] Jul 15 05:03:31.601944 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.601912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl6cn\" (UniqueName: \"kubernetes.io/projected/d2fe0a81-8e69-4756-b8ab-94424f6a2644-kube-api-access-cl6cn\") pod \"downloads-68c9cbb497-xfqj8\" (UID: \"d2fe0a81-8e69-4756-b8ab-94424f6a2644\") " pod="openshift-console/downloads-68c9cbb497-xfqj8" Jul 15 05:03:31.703331 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.703291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl6cn\" (UniqueName: \"kubernetes.io/projected/d2fe0a81-8e69-4756-b8ab-94424f6a2644-kube-api-access-cl6cn\") pod \"downloads-68c9cbb497-xfqj8\" (UID: \"d2fe0a81-8e69-4756-b8ab-94424f6a2644\") " pod="openshift-console/downloads-68c9cbb497-xfqj8" Jul 15 05:03:31.721399 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.721367 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl6cn\" (UniqueName: \"kubernetes.io/projected/d2fe0a81-8e69-4756-b8ab-94424f6a2644-kube-api-access-cl6cn\") pod \"downloads-68c9cbb497-xfqj8\" (UID: \"d2fe0a81-8e69-4756-b8ab-94424f6a2644\") " pod="openshift-console/downloads-68c9cbb497-xfqj8" Jul 15 05:03:31.794855 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.794759 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-frbgm" event={"ID":"4364a2ff-f67b-416d-a4b5-6fcccf00eabd","Type":"ContainerStarted","Data":"67e290d481fe009bd49ffc422d05386200472314d312efbf06a2ae90fb973919"} Jul 15 05:03:31.812930 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.812897 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-xfqj8" Jul 15 05:03:31.815442 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.815392 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-frbgm" podStartSLOduration=17.10583122 podStartE2EDuration="23.815376465s" totalImagesPullingTime="6.709545245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 05:03:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:31.81409193 +0000 UTC m=+296.547752075" watchObservedRunningTime="2026-07-15 05:03:31.815376465 +0000 UTC m=+296.549036622" Jul 15 05:03:31.947166 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:31.947132 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-xfqj8"] Jul 15 05:03:31.951384 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:31.951341 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2fe0a81_8e69_4756_b8ab_94424f6a2644.slice/crio-5b57ea61360056aa8e9d9c803e245c0abbbab94537531dcdc3896fd4178e0c2b WatchSource:0}: Error finding container 5b57ea61360056aa8e9d9c803e245c0abbbab94537531dcdc3896fd4178e0c2b: Status 404 returned error can't find the container with id 5b57ea61360056aa8e9d9c803e245c0abbbab94537531dcdc3896fd4178e0c2b Jul 15 05:03:32.798683 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:32.798645 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xfqj8" event={"ID":"d2fe0a81-8e69-4756-b8ab-94424f6a2644","Type":"ContainerStarted","Data":"5b57ea61360056aa8e9d9c803e245c0abbbab94537531dcdc3896fd4178e0c2b"} Jul 15 05:03:34.425472 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:34.425436 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:34.426105 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:34.426083 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daaf9555-260f-47d0-8f19-144baa1c99c3-service-ca-bundle\") pod \"router-default-6dcbcd97b-tsqv2\" (UID: \"daaf9555-260f-47d0-8f19-144baa1c99c3\") " pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:34.696380 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:34.696288 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:34.766503 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:34.766276 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b9v4z" Jul 15 05:03:34.866170 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:34.865986 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6dcbcd97b-tsqv2"] Jul 15 05:03:34.868986 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:34.868950 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaaf9555_260f_47d0_8f19_144baa1c99c3.slice/crio-f9b08810d64721c7082cfb0cc7eabe7c3c1dd822c74f86f7a7b29e7c8bd31fea WatchSource:0}: Error finding container f9b08810d64721c7082cfb0cc7eabe7c3c1dd822c74f86f7a7b29e7c8bd31fea: Status 404 returned error can't find the container with id f9b08810d64721c7082cfb0cc7eabe7c3c1dd822c74f86f7a7b29e7c8bd31fea Jul 15 05:03:35.665851 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:35.665819 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:03:35.666886 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:35.666857 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:03:35.680483 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:35.680442 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:03:35.681554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:35.681528 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:03:35.683844 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:35.683825 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 05:03:35.813246 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:35.813201 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" event={"ID":"daaf9555-260f-47d0-8f19-144baa1c99c3","Type":"ContainerStarted","Data":"d1f75dd9097c0b3523587798254686c36f842245cd3523513052b5a96eaca8b9"} Jul 15 05:03:35.813423 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:35.813265 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" event={"ID":"daaf9555-260f-47d0-8f19-144baa1c99c3","Type":"ContainerStarted","Data":"f9b08810d64721c7082cfb0cc7eabe7c3c1dd822c74f86f7a7b29e7c8bd31fea"} Jul 15 05:03:35.832303 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:35.832106 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" podStartSLOduration=33.832084046 podStartE2EDuration="33.832084046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:35.831846574 +0000 UTC m=+300.565506723" watchObservedRunningTime="2026-07-15 05:03:35.832084046 +0000 UTC m=+300.565744196" Jul 15 05:03:36.697420 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:36.697383 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:36.700410 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:36.700381 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:36.817072 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:36.817044 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:36.818470 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:36.818443 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6dcbcd97b-tsqv2" Jul 15 05:03:38.651634 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:38.651587 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq"] Jul 15 05:03:38.654884 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:38.654862 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" Jul 15 05:03:38.657009 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:38.656980 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 05:03:38.657175 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:38.657071 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-d79jq\"" Jul 15 05:03:38.661592 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:38.661528 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq"] Jul 15 05:03:38.765988 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:38.765948 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-t2vrq\" (UID: \"86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" Jul 15 05:03:38.867285 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:38.867244 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-t2vrq\" (UID: \"86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" Jul 15 05:03:38.867481 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:38.867420 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 15 05:03:38.867536 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:38.867510 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc-tls-certificates podName:86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc nodeName:}" failed. No retries permitted until 2026-07-15 05:03:39.367481795 +0000 UTC m=+304.101141922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-t2vrq" (UID: "86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc") : secret "prometheus-operator-admission-webhook-tls" not found Jul 15 05:03:39.371131 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:39.371092 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-t2vrq\" (UID: \"86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" Jul 15 05:03:39.373849 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:39.373821 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-t2vrq\" (UID: \"86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" Jul 15 05:03:39.566928 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:39.566886 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" Jul 15 05:03:39.732536 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:39.732486 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq"] Jul 15 05:03:39.735883 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:39.735849 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ee7b3f_b1c0_4f26_a5ed_00e9477f71dc.slice/crio-f55ae87f801f8b124ee8fda78ad8e2cd6b511e1674d5cb6c08c45e07d139f5a9 WatchSource:0}: Error finding container f55ae87f801f8b124ee8fda78ad8e2cd6b511e1674d5cb6c08c45e07d139f5a9: Status 404 returned error can't find the container with id f55ae87f801f8b124ee8fda78ad8e2cd6b511e1674d5cb6c08c45e07d139f5a9 Jul 15 05:03:39.738304 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:39.738286 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 05:03:39.793717 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:39.789250 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 05:03:39.831160 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:39.831115 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" event={"ID":"86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc","Type":"ContainerStarted","Data":"f55ae87f801f8b124ee8fda78ad8e2cd6b511e1674d5cb6c08c45e07d139f5a9"} Jul 15 05:03:40.738969 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:40.738918 2555 patch_prober.go:28] interesting pod/image-registry-5f887b58fb-999ng container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 15 05:03:40.739384 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:40.738992 2555 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" podUID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 05:03:42.843753 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:42.843704 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" event={"ID":"86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc","Type":"ContainerStarted","Data":"3717e72f6880016bb04706b9d15b99e466446ae2912bbc97a5cec7d4675ff889"} Jul 15 05:03:42.844126 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:42.843948 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" Jul 15 05:03:42.848944 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:42.848919 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" Jul 15 05:03:42.860693 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:42.860629 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-t2vrq" podStartSLOduration=2.846665739 podStartE2EDuration="4.860608458s" totalImagesPullingTime="2.013942719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:42.859308473 +0000 UTC m=+307.592968622" watchObservedRunningTime="2026-07-15 05:03:42.860608458 +0000 UTC m=+307.594268588" Jul 15 05:03:43.712781 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.712743 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-qbtrb"] Jul 15 05:03:43.730812 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.730777 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-qbtrb"] Jul 15 05:03:43.730992 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.730937 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.733625 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.733441 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 05:03:43.733625 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.733466 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 15 05:03:43.733625 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.733514 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 15 05:03:43.733625 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.733533 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 05:03:43.733625 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.733533 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-frlmk\"" Jul 15 05:03:43.734138 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.734119 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 05:03:43.758464 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.758435 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:03:43.810112 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.810081 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9p5\" (UniqueName: \"kubernetes.io/projected/719e56a0-b008-4bd1-a210-0222c217a64b-kube-api-access-wb9p5\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.810112 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.810116 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719e56a0-b008-4bd1-a210-0222c217a64b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.810349 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.810187 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.810349 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.810318 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.911392 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.911351 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9p5\" (UniqueName: \"kubernetes.io/projected/719e56a0-b008-4bd1-a210-0222c217a64b-kube-api-access-wb9p5\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.911392 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.911395 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719e56a0-b008-4bd1-a210-0222c217a64b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.911932 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.911642 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.911932 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:43.911712 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 15 05:03:43.911932 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:03:43.911789 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-tls podName:719e56a0-b008-4bd1-a210-0222c217a64b nodeName:}" failed. No retries permitted until 2026-07-15 05:03:44.411769042 +0000 UTC m=+309.145429186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-tls") pod "prometheus-operator-64785b6675-qbtrb" (UID: "719e56a0-b008-4bd1-a210-0222c217a64b") : secret "prometheus-operator-tls" not found Jul 15 05:03:43.911932 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.911898 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.912323 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.912291 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/719e56a0-b008-4bd1-a210-0222c217a64b-metrics-client-ca\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.914401 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.914380 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:43.920317 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:43.920281 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9p5\" (UniqueName: \"kubernetes.io/projected/719e56a0-b008-4bd1-a210-0222c217a64b-kube-api-access-wb9p5\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:44.415902 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:44.415853 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:44.418572 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:44.418542 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/719e56a0-b008-4bd1-a210-0222c217a64b-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-qbtrb\" (UID: \"719e56a0-b008-4bd1-a210-0222c217a64b\") " pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:44.643088 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:44.643037 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" Jul 15 05:03:51.840281 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:51.840253 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-qbtrb"] Jul 15 05:03:51.843237 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:51.843203 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719e56a0_b008_4bd1_a210_0222c217a64b.slice/crio-5e9f6ed2a5266c51e72203c28eea8dde33e0e49cce59cbaa3e90963ee7616086 WatchSource:0}: Error finding container 5e9f6ed2a5266c51e72203c28eea8dde33e0e49cce59cbaa3e90963ee7616086: Status 404 returned error can't find the container with id 5e9f6ed2a5266c51e72203c28eea8dde33e0e49cce59cbaa3e90963ee7616086 Jul 15 05:03:51.879628 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:51.879594 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-xfqj8" event={"ID":"d2fe0a81-8e69-4756-b8ab-94424f6a2644","Type":"ContainerStarted","Data":"b4bc1e46f9bb901783d0ee95599c2ad296b4f5c5eac3c1ca6c7637e6a250a0de"} Jul 15 05:03:51.879852 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:51.879833 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-xfqj8" Jul 15 05:03:51.881383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:51.881295 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" event={"ID":"719e56a0-b008-4bd1-a210-0222c217a64b","Type":"ContainerStarted","Data":"5e9f6ed2a5266c51e72203c28eea8dde33e0e49cce59cbaa3e90963ee7616086"} Jul 15 05:03:51.881898 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:51.881875 2555 patch_prober.go:28] interesting pod/downloads-68c9cbb497-xfqj8 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.18:8080/\": dial tcp 10.132.0.18:8080: connect: connection refused" start-of-body= Jul 15 05:03:51.882002 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:51.881916 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-xfqj8" podUID="d2fe0a81-8e69-4756-b8ab-94424f6a2644" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.18:8080/\": dial tcp 10.132.0.18:8080: connect: connection refused" Jul 15 05:03:51.897162 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:51.897100 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-xfqj8" podStartSLOduration=1.091311701 podStartE2EDuration="20.89708194s" totalImagesPullingTime="19.805770239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:51.896020826 +0000 UTC m=+316.629680975" watchObservedRunningTime="2026-07-15 05:03:51.89708194 +0000 UTC m=+316.630742092" Jul 15 05:03:52.899322 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:52.899041 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-xfqj8" Jul 15 05:03:53.874424 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:53.874387 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f887b58fb-999ng"] Jul 15 05:03:53.897187 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:53.897142 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" event={"ID":"719e56a0-b008-4bd1-a210-0222c217a64b","Type":"ContainerStarted","Data":"4a443cba7947535fa43eab6e28fe260c0eceec1e0d66b524f42d4e184d835de5"} Jul 15 05:03:53.897375 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:53.897210 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" event={"ID":"719e56a0-b008-4bd1-a210-0222c217a64b","Type":"ContainerStarted","Data":"ba54f6129bae8d979afc33580f56dc158a7173032c8800d6cb49810f8567dcd7"} Jul 15 05:03:56.100234 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.100172 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-qbtrb" podStartSLOduration=11.455938922 podStartE2EDuration="13.100136885s" totalImagesPullingTime="1.644197963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:53.914738209 +0000 UTC m=+318.648398349" watchObservedRunningTime="2026-07-15 05:03:56.100136885 +0000 UTC m=+320.833797040" Jul 15 05:03:56.101841 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.101803 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wxjx7"] Jul 15 05:03:56.138489 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.138457 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8mpl6"] Jul 15 05:03:56.138670 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.138596 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.140975 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.140944 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 05:03:56.141462 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.141425 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 05:03:56.141569 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.141470 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 05:03:56.146617 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.142005 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-przps\"" Jul 15 05:03:56.168404 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.168368 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wxjx7"] Jul 15 05:03:56.168638 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.168518 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.170974 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.170948 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 05:03:56.171185 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.171000 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fl7xt\"" Jul 15 05:03:56.171310 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.171085 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 05:03:56.171310 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.171092 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 05:03:56.222006 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.221959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ccd6319-2339-4eae-983b-67e8a74cd67e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.222191 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.222014 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ccd6319-2339-4eae-983b-67e8a74cd67e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.222191 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.222114 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.222191 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.222152 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.222191 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.222188 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhnz\" (UniqueName: \"kubernetes.io/projected/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-api-access-vrhnz\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.222381 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.222235 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.323631 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ccd6319-2339-4eae-983b-67e8a74cd67e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.323631 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323640 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-tls\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.323909 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323788 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.323909 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323834 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.323909 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323870 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87b6e940-b238-4c1b-be14-6d6b02f43f3d-metrics-client-ca\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.323909 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323901 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-sys\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.324108 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhnz\" (UniqueName: \"kubernetes.io/projected/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-api-access-vrhnz\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.324108 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323955 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-root\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.324108 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.323990 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.324108 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324039 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.324108 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324067 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69bnq\" (UniqueName: \"kubernetes.io/projected/87b6e940-b238-4c1b-be14-6d6b02f43f3d-kube-api-access-69bnq\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.324108 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324101 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.324388 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324130 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-textfile\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.324388 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324160 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ccd6319-2339-4eae-983b-67e8a74cd67e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.324388 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324191 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-wtmp\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.324659 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324622 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.324822 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324716 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ccd6319-2339-4eae-983b-67e8a74cd67e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.325006 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.324987 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ccd6319-2339-4eae-983b-67e8a74cd67e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.326896 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.326869 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.327171 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.327145 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.338402 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.338366 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhnz\" (UniqueName: \"kubernetes.io/projected/7ccd6319-2339-4eae-983b-67e8a74cd67e-kube-api-access-vrhnz\") pod \"kube-state-metrics-785778ff74-wxjx7\" (UID: \"7ccd6319-2339-4eae-983b-67e8a74cd67e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.424683 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424585 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87b6e940-b238-4c1b-be14-6d6b02f43f3d-metrics-client-ca\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424683 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424642 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-sys\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424683 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424674 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-root\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424711 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424785 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69bnq\" (UniqueName: \"kubernetes.io/projected/87b6e940-b238-4c1b-be14-6d6b02f43f3d-kube-api-access-69bnq\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424719 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-sys\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424862 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-root\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424881 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-textfile\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424912 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-wtmp\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.424996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.424936 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-tls\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.425386 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.425303 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/87b6e940-b238-4c1b-be14-6d6b02f43f3d-metrics-client-ca\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.425885 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.425857 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.426010 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.425882 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-textfile\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.426071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.426013 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-wtmp\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.428810 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.428764 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-tls\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.429385 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.429360 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/87b6e940-b238-4c1b-be14-6d6b02f43f3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.433846 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.433823 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69bnq\" (UniqueName: \"kubernetes.io/projected/87b6e940-b238-4c1b-be14-6d6b02f43f3d-kube-api-access-69bnq\") pod \"node-exporter-8mpl6\" (UID: \"87b6e940-b238-4c1b-be14-6d6b02f43f3d\") " pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.456895 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.456857 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" Jul 15 05:03:56.480075 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.480041 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8mpl6" Jul 15 05:03:56.523177 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:56.523141 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b6e940_b238_4c1b_be14_6d6b02f43f3d.slice/crio-4bd9a8ef228c5ed95820d71f847fbe8eb900ba3d886f9e9e03223a33885a3fe0 WatchSource:0}: Error finding container 4bd9a8ef228c5ed95820d71f847fbe8eb900ba3d886f9e9e03223a33885a3fe0: Status 404 returned error can't find the container with id 4bd9a8ef228c5ed95820d71f847fbe8eb900ba3d886f9e9e03223a33885a3fe0 Jul 15 05:03:56.655070 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.655032 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-wxjx7"] Jul 15 05:03:56.658807 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:56.658768 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ccd6319_2339_4eae_983b_67e8a74cd67e.slice/crio-fee5134fb40259063c9557e710e2985adda2f95ce25297c74fea04d2ecc0322e WatchSource:0}: Error finding container fee5134fb40259063c9557e710e2985adda2f95ce25297c74fea04d2ecc0322e: Status 404 returned error can't find the container with id fee5134fb40259063c9557e710e2985adda2f95ce25297c74fea04d2ecc0322e Jul 15 05:03:56.910603 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.910549 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mpl6" event={"ID":"87b6e940-b238-4c1b-be14-6d6b02f43f3d","Type":"ContainerStarted","Data":"4bd9a8ef228c5ed95820d71f847fbe8eb900ba3d886f9e9e03223a33885a3fe0"} Jul 15 05:03:56.912120 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:56.912085 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" event={"ID":"7ccd6319-2339-4eae-983b-67e8a74cd67e","Type":"ContainerStarted","Data":"fee5134fb40259063c9557e710e2985adda2f95ce25297c74fea04d2ecc0322e"} Jul 15 05:03:57.162354 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.161904 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 05:03:57.179703 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.179664 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.181683 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.181646 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.182593 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.182626 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.182818 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.182891 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rvv64\"" Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.182955 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.183016 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.183146 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.183232 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 05:03:57.183493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.183276 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 05:03:57.184206 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.183541 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 05:03:57.333289 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333462 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333299 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74b1bf88-b4fc-495c-94ae-8bce464172c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333462 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333343 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74b1bf88-b4fc-495c-94ae-8bce464172c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333462 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333367 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333462 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333415 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b1bf88-b4fc-495c-94ae-8bce464172c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333462 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333439 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333463 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333498 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-web-config\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333534 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74b1bf88-b4fc-495c-94ae-8bce464172c0-config-out\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333578 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74b1bf88-b4fc-495c-94ae-8bce464172c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.333714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.333683 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wd6z\" (UniqueName: \"kubernetes.io/projected/74b1bf88-b4fc-495c-94ae-8bce464172c0-kube-api-access-9wd6z\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434498 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434396 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74b1bf88-b4fc-495c-94ae-8bce464172c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434498 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434457 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b1bf88-b4fc-495c-94ae-8bce464172c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434545 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434570 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-web-config\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434639 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74b1bf88-b4fc-495c-94ae-8bce464172c0-config-out\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.434773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434708 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.435136 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74b1bf88-b4fc-495c-94ae-8bce464172c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.435136 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434811 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wd6z\" (UniqueName: \"kubernetes.io/projected/74b1bf88-b4fc-495c-94ae-8bce464172c0-kube-api-access-9wd6z\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.435136 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434843 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.435136 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.434858 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74b1bf88-b4fc-495c-94ae-8bce464172c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.435418 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.435333 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/74b1bf88-b4fc-495c-94ae-8bce464172c0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.435743 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.435703 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74b1bf88-b4fc-495c-94ae-8bce464172c0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.439835 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.439442 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.439835 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.439763 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74b1bf88-b4fc-495c-94ae-8bce464172c0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.442106 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.441712 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74b1bf88-b4fc-495c-94ae-8bce464172c0-config-out\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.442106 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.441934 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.442106 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.441990 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.442106 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.442054 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74b1bf88-b4fc-495c-94ae-8bce464172c0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.442106 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.442064 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-web-config\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.442456 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.442288 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-config-volume\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.442827 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.442784 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.445847 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.445805 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wd6z\" (UniqueName: \"kubernetes.io/projected/74b1bf88-b4fc-495c-94ae-8bce464172c0-kube-api-access-9wd6z\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.447145 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.447104 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74b1bf88-b4fc-495c-94ae-8bce464172c0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"74b1bf88-b4fc-495c-94ae-8bce464172c0\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:57.498165 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:57.497899 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 05:03:58.037857 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:58.037751 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 05:03:58.487532 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:03:58.487488 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b1bf88_b4fc_495c_94ae_8bce464172c0.slice/crio-e68bc7246853716587e2eb093bbf3191be4f9345d4e210281a37350f7cec9656 WatchSource:0}: Error finding container e68bc7246853716587e2eb093bbf3191be4f9345d4e210281a37350f7cec9656: Status 404 returned error can't find the container with id e68bc7246853716587e2eb093bbf3191be4f9345d4e210281a37350f7cec9656 Jul 15 05:03:58.928591 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:58.928542 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mpl6" event={"ID":"87b6e940-b238-4c1b-be14-6d6b02f43f3d","Type":"ContainerStarted","Data":"7308b8d8cb936485592fbd9685f50228176bfd0f6a2dd904133de1b84c5677f9"} Jul 15 05:03:58.932390 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:58.932278 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" event={"ID":"7ccd6319-2339-4eae-983b-67e8a74cd67e","Type":"ContainerStarted","Data":"8c0882fd04a8baca064fe50fbb0c64ce9d56ff7be7bf5c799accddfd487ecb54"} Jul 15 05:03:58.932390 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:58.932353 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" event={"ID":"7ccd6319-2339-4eae-983b-67e8a74cd67e","Type":"ContainerStarted","Data":"d24c008b08a0daebcb579d7cac95847f3c262c1478fa8ae05680d1bd912d7d5f"} Jul 15 05:03:58.935065 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:58.935033 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b1bf88-b4fc-495c-94ae-8bce464172c0","Type":"ContainerStarted","Data":"e68bc7246853716587e2eb093bbf3191be4f9345d4e210281a37350f7cec9656"} Jul 15 05:03:59.941896 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:59.941859 2555 generic.go:356] "Generic (PLEG): container finished" podID="87b6e940-b238-4c1b-be14-6d6b02f43f3d" containerID="7308b8d8cb936485592fbd9685f50228176bfd0f6a2dd904133de1b84c5677f9" exitCode=0 Jul 15 05:03:59.942468 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:59.942193 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mpl6" event={"ID":"87b6e940-b238-4c1b-be14-6d6b02f43f3d","Type":"ContainerDied","Data":"7308b8d8cb936485592fbd9685f50228176bfd0f6a2dd904133de1b84c5677f9"} Jul 15 05:03:59.945255 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:59.945220 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" event={"ID":"7ccd6319-2339-4eae-983b-67e8a74cd67e","Type":"ContainerStarted","Data":"67c1c2f1b1cebe851661340870e061b015577c83452068a0603c93e9ec67f950"} Jul 15 05:03:59.988326 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:03:59.988260 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-wxjx7" podStartSLOduration=1.973179949 podStartE2EDuration="3.98824148s" totalImagesPullingTime="2.015061531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:03:59.986553751 +0000 UTC m=+324.720213924" watchObservedRunningTime="2026-07-15 05:03:59.98824148 +0000 UTC m=+324.721901629" Jul 15 05:04:00.887463 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.887414 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx"] Jul 15 05:04:00.910049 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.910014 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx"] Jul 15 05:04:00.910239 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.910155 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:00.912554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.912526 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 15 05:04:00.912715 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.912534 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fm6rt\"" Jul 15 05:04:00.952088 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.952048 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mpl6" event={"ID":"87b6e940-b238-4c1b-be14-6d6b02f43f3d","Type":"ContainerStarted","Data":"5468f2458f057e01da9018e677d53f84449e158e3c048afe0c1acfca9f4cfc8a"} Jul 15 05:04:00.952508 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.952117 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mpl6" event={"ID":"87b6e940-b238-4c1b-be14-6d6b02f43f3d","Type":"ContainerStarted","Data":"c34cd0c09c34ce032d4aec7b7ed02879bf42a86103a3574f9b850bd9157be726"} Jul 15 05:04:00.953570 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.953541 2555 generic.go:356] "Generic (PLEG): container finished" podID="74b1bf88-b4fc-495c-94ae-8bce464172c0" containerID="b35f1ece14571908c6edaee94c199e325e8ad513630639ffd72c9adb0b99b1a8" exitCode=0 Jul 15 05:04:00.953679 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.953623 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b1bf88-b4fc-495c-94ae-8bce464172c0","Type":"ContainerDied","Data":"b35f1ece14571908c6edaee94c199e325e8ad513630639ffd72c9adb0b99b1a8"} Jul 15 05:04:00.971719 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:00.971649 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8mpl6" podStartSLOduration=2.682712123 podStartE2EDuration="4.97162659s" totalImagesPullingTime="2.147859877s" totalInitContainerRuntime="141.05459ms" isStatefulPod=true podCreationTimestamp="2026-07-15 05:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:04:00.968988394 +0000 UTC m=+325.702648547" watchObservedRunningTime="2026-07-15 05:04:00.97162659 +0000 UTC m=+325.705286740" Jul 15 05:04:01.074030 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:01.073979 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhclh\" (UniqueName: \"kubernetes.io/projected/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-kube-api-access-lhclh\") pod \"monitoring-plugin-5f68df7f58-cwmlx\" (UID: \"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:01.074296 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:01.074269 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cwmlx\" (UID: \"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:01.175637 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:01.175531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cwmlx\" (UID: \"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:01.175827 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:01.175653 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhclh\" (UniqueName: \"kubernetes.io/projected/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-kube-api-access-lhclh\") pod \"monitoring-plugin-5f68df7f58-cwmlx\" (UID: \"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:01.175827 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:04:01.175677 2555 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 15 05:04:01.175827 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:04:01.175781 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-monitoring-plugin-cert podName:d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3 nodeName:}" failed. No retries permitted until 2026-07-15 05:04:01.67575829 +0000 UTC m=+326.409418418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-cwmlx" (UID: "d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3") : secret "monitoring-plugin-cert" not found Jul 15 05:04:01.186058 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:01.186031 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhclh\" (UniqueName: \"kubernetes.io/projected/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-kube-api-access-lhclh\") pod \"monitoring-plugin-5f68df7f58-cwmlx\" (UID: \"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:01.680073 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:01.680028 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cwmlx\" (UID: \"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:01.682588 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:01.682561 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-cwmlx\" (UID: \"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:01.821411 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:01.821374 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:02.004082 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:02.003798 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx"] Jul 15 05:04:02.006393 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:04:02.006368 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f6f7fe_f0bc_4624_bf38_ff57bd7138f3.slice/crio-c775b12fd4ab0767402f55e44576bbab150bbdc71e143a64842d39f18accd8b8 WatchSource:0}: Error finding container c775b12fd4ab0767402f55e44576bbab150bbdc71e143a64842d39f18accd8b8: Status 404 returned error can't find the container with id c775b12fd4ab0767402f55e44576bbab150bbdc71e143a64842d39f18accd8b8 Jul 15 05:04:02.965463 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:02.965419 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" event={"ID":"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3","Type":"ContainerStarted","Data":"c775b12fd4ab0767402f55e44576bbab150bbdc71e143a64842d39f18accd8b8"} Jul 15 05:04:04.974881 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.974828 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" event={"ID":"d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3","Type":"ContainerStarted","Data":"8a85d341fb2dfc89acba4398b5f60ace74d4bab01eb4f08c286a15895bc19ceb"} Jul 15 05:04:04.975559 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.975531 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:04.978700 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.978674 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b1bf88-b4fc-495c-94ae-8bce464172c0","Type":"ContainerStarted","Data":"0457699904ca3a9e48f93cf20c06f503fcb184aa2aa63416feb9f6d738e10088"} Jul 15 05:04:04.978837 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.978767 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b1bf88-b4fc-495c-94ae-8bce464172c0","Type":"ContainerStarted","Data":"c339211697e702d19369b6d7579def12dcdec2e7ac725b7cf05e06b663d8cbca"} Jul 15 05:04:04.978837 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.978808 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b1bf88-b4fc-495c-94ae-8bce464172c0","Type":"ContainerStarted","Data":"518b748d08217d5481304c8db0fb85eabab86317480a73dba98ee999d96f0873"} Jul 15 05:04:04.978906 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.978849 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b1bf88-b4fc-495c-94ae-8bce464172c0","Type":"ContainerStarted","Data":"42072e6650847d04e8f330ce15f1f5b2a875054977cd516519889c3ba95c8b71"} Jul 15 05:04:04.978906 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.978885 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b1bf88-b4fc-495c-94ae-8bce464172c0","Type":"ContainerStarted","Data":"663bd93e27760c215c564535d0ff7e42d441cb078e1fe0d1f510382ff468309e"} Jul 15 05:04:04.981050 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.981030 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" Jul 15 05:04:04.989588 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:04.989536 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-cwmlx" podStartSLOduration=2.704562692 podStartE2EDuration="4.989520095s" totalImagesPullingTime="2.284957403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:04:04.988315953 +0000 UTC m=+329.721976103" watchObservedRunningTime="2026-07-15 05:04:04.989520095 +0000 UTC m=+329.723180244" Jul 15 05:04:06.994984 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:06.994950 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"74b1bf88-b4fc-495c-94ae-8bce464172c0","Type":"ContainerStarted","Data":"0d9a17173e5944b2c860ef272ced8e0624f2059addbe9ba1443ea2d74fe517e1"} Jul 15 05:04:07.020432 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:07.020377 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.10673195 podStartE2EDuration="10.020359822s" totalImagesPullingTime="5.898656129s" totalInitContainerRuntime="14.971743ms" isStatefulPod=false podCreationTimestamp="2026-07-15 05:03:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:04:07.01878964 +0000 UTC m=+331.752449788" watchObservedRunningTime="2026-07-15 05:04:07.020359822 +0000 UTC m=+331.754019971" Jul 15 05:04:18.902154 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:18.902084 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" podUID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" containerName="registry" containerID="cri-o://3698e91f5ca53f7443547a744a8e0427deb6d8d638a81f078b85379d0bb05ab5" gracePeriod=30 Jul 15 05:04:19.045896 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.045756 2555 generic.go:356] "Generic (PLEG): container finished" podID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" containerID="3698e91f5ca53f7443547a744a8e0427deb6d8d638a81f078b85379d0bb05ab5" exitCode=0 Jul 15 05:04:19.045896 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.045813 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" event={"ID":"7e4495d1-9d00-4adf-8c0e-bd844ad4e459","Type":"ContainerDied","Data":"3698e91f5ca53f7443547a744a8e0427deb6d8d638a81f078b85379d0bb05ab5"} Jul 15 05:04:19.189089 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.189053 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:04:19.235497 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.235463 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-certificates\") pod \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " Jul 15 05:04:19.235682 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.235516 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-image-registry-private-configuration\") pod \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " Jul 15 05:04:19.235682 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.235538 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mrsb\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-kube-api-access-2mrsb\") pod \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " Jul 15 05:04:19.235682 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.235556 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-bound-sa-token\") pod \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " Jul 15 05:04:19.235682 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.235584 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-ca-trust-extracted\") pod \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " Jul 15 05:04:19.235682 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.235617 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") pod \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " Jul 15 05:04:19.235682 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.235666 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-trusted-ca\") pod \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " Jul 15 05:04:19.236000 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.235713 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-installation-pull-secrets\") pod \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\" (UID: \"7e4495d1-9d00-4adf-8c0e-bd844ad4e459\") " Jul 15 05:04:19.236260 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.236225 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7e4495d1-9d00-4adf-8c0e-bd844ad4e459" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:04:19.236383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.236298 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7e4495d1-9d00-4adf-8c0e-bd844ad4e459" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:04:19.238314 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.238255 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7e4495d1-9d00-4adf-8c0e-bd844ad4e459" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:04:19.238432 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.238310 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7e4495d1-9d00-4adf-8c0e-bd844ad4e459" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 05:04:19.238432 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.238414 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7e4495d1-9d00-4adf-8c0e-bd844ad4e459" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:04:19.238554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.238488 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-kube-api-access-2mrsb" (OuterVolumeSpecName: "kube-api-access-2mrsb") pod "7e4495d1-9d00-4adf-8c0e-bd844ad4e459" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459"). InnerVolumeSpecName "kube-api-access-2mrsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:04:19.238618 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.238602 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7e4495d1-9d00-4adf-8c0e-bd844ad4e459" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 05:04:19.245035 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.245009 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7e4495d1-9d00-4adf-8c0e-bd844ad4e459" (UID: "7e4495d1-9d00-4adf-8c0e-bd844ad4e459"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:04:19.336898 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.336862 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-installation-pull-secrets\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:04:19.336898 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.336889 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-certificates\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:04:19.336898 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.336900 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-image-registry-private-configuration\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:04:19.336898 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.336910 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mrsb\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-kube-api-access-2mrsb\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:04:19.337170 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.336918 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-bound-sa-token\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:04:19.337170 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.336928 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-ca-trust-extracted\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:04:19.337170 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.336937 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-registry-tls\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:04:19.337170 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:19.336945 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7e4495d1-9d00-4adf-8c0e-bd844ad4e459-trusted-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:04:20.050786 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:20.050754 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" Jul 15 05:04:20.050786 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:20.050764 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f887b58fb-999ng" event={"ID":"7e4495d1-9d00-4adf-8c0e-bd844ad4e459","Type":"ContainerDied","Data":"e74823dcf0d5b91dcd2af768680c39cf070ccdd40118f485222e59d7f671af75"} Jul 15 05:04:20.051358 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:20.050825 2555 scope.go:117] "RemoveContainer" containerID="3698e91f5ca53f7443547a744a8e0427deb6d8d638a81f078b85379d0bb05ab5" Jul 15 05:04:20.070679 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:20.070645 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f887b58fb-999ng"] Jul 15 05:04:20.076150 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:20.076115 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f887b58fb-999ng"] Jul 15 05:04:21.794313 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:21.794275 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" path="/var/lib/kubelet/pods/7e4495d1-9d00-4adf-8c0e-bd844ad4e459/volumes" Jul 15 05:04:23.728007 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:23.727973 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcbcd97b-tsqv2_daaf9555-260f-47d0-8f19-144baa1c99c3/router/0.log" Jul 15 05:04:23.734527 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:23.734501 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d8l9m_0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02/serve-healthcheck-canary/0.log" Jul 15 05:04:32.100253 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:32.100216 2555 generic.go:356] "Generic (PLEG): container finished" podID="f997f522-722e-467c-84d1-5891c9bbd12c" containerID="5e6349fd36951c046230c5cfd87ea88edd424bf9565b2825ecd076bbd5509d21" exitCode=0 Jul 15 05:04:32.100663 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:32.100272 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" event={"ID":"f997f522-722e-467c-84d1-5891c9bbd12c","Type":"ContainerDied","Data":"5e6349fd36951c046230c5cfd87ea88edd424bf9565b2825ecd076bbd5509d21"} Jul 15 05:04:32.100663 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:32.100613 2555 scope.go:117] "RemoveContainer" containerID="5e6349fd36951c046230c5cfd87ea88edd424bf9565b2825ecd076bbd5509d21" Jul 15 05:04:33.105392 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:33.105357 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-b7h97" event={"ID":"f997f522-722e-467c-84d1-5891c9bbd12c","Type":"ContainerStarted","Data":"42cb7e01d9256eca2edc5e7e3fae1c6eceb59ee73a78092aad982c4ea856e5cc"} Jul 15 05:04:37.124349 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:37.124314 2555 generic.go:356] "Generic (PLEG): container finished" podID="9d2edac7-0629-49c4-ab63-4e3ab3fa3a34" containerID="5e2b5a7171e3e898b2c5acfba72b8b92723c239a1f805aa7ceaea9d393fd1a65" exitCode=0 Jul 15 05:04:37.124831 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:37.124363 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" event={"ID":"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34","Type":"ContainerDied","Data":"5e2b5a7171e3e898b2c5acfba72b8b92723c239a1f805aa7ceaea9d393fd1a65"} Jul 15 05:04:37.124831 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:37.124712 2555 scope.go:117] "RemoveContainer" containerID="5e2b5a7171e3e898b2c5acfba72b8b92723c239a1f805aa7ceaea9d393fd1a65" Jul 15 05:04:38.130376 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:38.130339 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9w7hq" event={"ID":"9d2edac7-0629-49c4-ab63-4e3ab3fa3a34","Type":"ContainerStarted","Data":"cb6b78ab29396d6f7e83195374664288bf139db8fb1de66194976949dc2731f5"} Jul 15 05:04:49.809965 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:49.809920 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 05:04:49.812360 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:49.812332 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d8d7341-69a1-4be5-b75c-ad4079b82ca6-metrics-certs\") pod \"network-metrics-daemon-f45b8\" (UID: \"8d8d7341-69a1-4be5-b75c-ad4079b82ca6\") " pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 05:04:49.993397 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:49.993366 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9bt4r\"" Jul 15 05:04:50.001107 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:50.001076 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f45b8" Jul 15 05:04:50.134197 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:50.134164 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f45b8"] Jul 15 05:04:50.137359 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:04:50.137322 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d8d7341_69a1_4be5_b75c_ad4079b82ca6.slice/crio-bef21117ba6c519a9ed29d4e7d5d9f06e35ad304ea6da271675fa81fb9782b9d WatchSource:0}: Error finding container bef21117ba6c519a9ed29d4e7d5d9f06e35ad304ea6da271675fa81fb9782b9d: Status 404 returned error can't find the container with id bef21117ba6c519a9ed29d4e7d5d9f06e35ad304ea6da271675fa81fb9782b9d Jul 15 05:04:50.179944 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:50.179910 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f45b8" event={"ID":"8d8d7341-69a1-4be5-b75c-ad4079b82ca6","Type":"ContainerStarted","Data":"bef21117ba6c519a9ed29d4e7d5d9f06e35ad304ea6da271675fa81fb9782b9d"} Jul 15 05:04:51.187771 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:51.187734 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f45b8" event={"ID":"8d8d7341-69a1-4be5-b75c-ad4079b82ca6","Type":"ContainerStarted","Data":"083f2c02826f95dcc0d3d28d62e92e2001d7aa78dd74597b462b6251a32a2078"} Jul 15 05:04:52.194323 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:52.194281 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f45b8" event={"ID":"8d8d7341-69a1-4be5-b75c-ad4079b82ca6","Type":"ContainerStarted","Data":"73b4fa7bcce977f58e0ea81c9f35dcf4c6953666a2e8e07a14915c4f0f52511d"} Jul 15 05:04:52.210892 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:04:52.210837 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f45b8" podStartSLOduration=375.324930888 podStartE2EDuration="6m16.210821823s" totalImagesPullingTime="885.890935ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 04:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:04:52.209937074 +0000 UTC m=+376.943597223" watchObservedRunningTime="2026-07-15 05:04:52.210821823 +0000 UTC m=+376.944481976" Jul 15 05:05:20.444537 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.444492 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2"] Jul 15 05:05:20.445269 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.445245 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" containerName="registry" Jul 15 05:05:20.445366 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.445273 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" containerName="registry" Jul 15 05:05:20.445481 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.445468 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e4495d1-9d00-4adf-8c0e-bd844ad4e459" containerName="registry" Jul 15 05:05:20.450866 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.450831 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.453318 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.453287 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 05:05:20.453463 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.453296 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l6jwp\"" Jul 15 05:05:20.453742 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.453687 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 05:05:20.453742 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.453687 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 05:05:20.453995 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.453779 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 05:05:20.453995 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.453826 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 05:05:20.460768 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.460737 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 05:05:20.462636 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.462605 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2"] Jul 15 05:05:20.556292 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.556254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-serving-certs-ca-bundle\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.556292 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.556294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zz5p\" (UniqueName: \"kubernetes.io/projected/66646fdc-695b-446a-abf2-256435ae0cb6-kube-api-access-8zz5p\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.556505 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.556320 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-telemeter-client-tls\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.556505 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.556379 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.556505 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.556466 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-secret-telemeter-client\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.556505 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.556497 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-federate-client-tls\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.556630 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.556556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.556630 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.556590 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-metrics-client-ca\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.657509 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.657455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-metrics-client-ca\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.657705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.657529 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-serving-certs-ca-bundle\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.657705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.657556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zz5p\" (UniqueName: \"kubernetes.io/projected/66646fdc-695b-446a-abf2-256435ae0cb6-kube-api-access-8zz5p\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.657705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.657577 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-telemeter-client-tls\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.657705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.657602 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.657705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.657638 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-secret-telemeter-client\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.657705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.657667 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-federate-client-tls\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.658078 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.657715 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.658429 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.658396 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-metrics-client-ca\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.658806 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.658777 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-serving-certs-ca-bundle\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.659085 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.659062 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66646fdc-695b-446a-abf2-256435ae0cb6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.660195 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.660165 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.660307 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.660295 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-telemeter-client-tls\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.660423 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.660403 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-secret-telemeter-client\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.660503 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.660480 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/66646fdc-695b-446a-abf2-256435ae0cb6-federate-client-tls\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.666909 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.666878 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zz5p\" (UniqueName: \"kubernetes.io/projected/66646fdc-695b-446a-abf2-256435ae0cb6-kube-api-access-8zz5p\") pod \"telemeter-client-5df56d9fbd-rpbf2\" (UID: \"66646fdc-695b-446a-abf2-256435ae0cb6\") " pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.763415 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.763313 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" Jul 15 05:05:20.906650 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:20.906626 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2"] Jul 15 05:05:20.909344 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:05:20.909315 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66646fdc_695b_446a_abf2_256435ae0cb6.slice/crio-efd8ec6fc6c4d09f643691abbb53605c0b20af39d51de01ce86986c662422895 WatchSource:0}: Error finding container efd8ec6fc6c4d09f643691abbb53605c0b20af39d51de01ce86986c662422895: Status 404 returned error can't find the container with id efd8ec6fc6c4d09f643691abbb53605c0b20af39d51de01ce86986c662422895 Jul 15 05:05:21.309820 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:21.309780 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" event={"ID":"66646fdc-695b-446a-abf2-256435ae0cb6","Type":"ContainerStarted","Data":"efd8ec6fc6c4d09f643691abbb53605c0b20af39d51de01ce86986c662422895"} Jul 15 05:05:23.320337 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:23.320304 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" event={"ID":"66646fdc-695b-446a-abf2-256435ae0cb6","Type":"ContainerStarted","Data":"350d4829dd6ea9cf642bf345892ae3f9e2f8409e4fb9e74d3a415e45799249eb"} Jul 15 05:05:23.320714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:23.320357 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" event={"ID":"66646fdc-695b-446a-abf2-256435ae0cb6","Type":"ContainerStarted","Data":"53c3b319a4d1696644c033f1c0c82b03c099d36f4fd1c579e23500c6768d5f19"} Jul 15 05:05:23.320714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:23.320378 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" event={"ID":"66646fdc-695b-446a-abf2-256435ae0cb6","Type":"ContainerStarted","Data":"6911a1c67b8920b29b29d573d2370de156d259d283e1f78283ee21554cc593f9"} Jul 15 05:05:23.343835 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:05:23.343782 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5df56d9fbd-rpbf2" podStartSLOduration=1.6290654610000002 podStartE2EDuration="3.343758075s" totalImagesPullingTime="1.714692614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:05:23.343484408 +0000 UTC m=+408.077144557" watchObservedRunningTime="2026-07-15 05:05:23.343758075 +0000 UTC m=+408.077418227" Jul 15 05:06:49.249285 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.249200 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb"] Jul 15 05:06:49.252852 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.252832 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.255590 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.255562 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 05:06:49.255721 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.255583 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 05:06:49.256823 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.256795 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6k4b7\"" Jul 15 05:06:49.264254 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.264227 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb"] Jul 15 05:06:49.398469 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.398421 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7v7g\" (UniqueName: \"kubernetes.io/projected/dd2af81d-7e51-4d82-ace0-73cf70b563ec-kube-api-access-p7v7g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.398644 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.398483 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.398644 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.398518 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.499756 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.499658 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7v7g\" (UniqueName: \"kubernetes.io/projected/dd2af81d-7e51-4d82-ace0-73cf70b563ec-kube-api-access-p7v7g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.499756 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.499696 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.499756 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.499749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.500094 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.500073 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.500132 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.500098 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.508258 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.508224 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7v7g\" (UniqueName: \"kubernetes.io/projected/dd2af81d-7e51-4d82-ace0-73cf70b563ec-kube-api-access-p7v7g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.561905 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.561866 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:06:49.711287 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:49.711225 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb"] Jul 15 05:06:49.714304 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:06:49.714273 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2af81d_7e51_4d82_ace0_73cf70b563ec.slice/crio-eab8739b08a5fd8c2b1292a322a63086b1404d96a1d857a7e81280dbfc57a5da WatchSource:0}: Error finding container eab8739b08a5fd8c2b1292a322a63086b1404d96a1d857a7e81280dbfc57a5da: Status 404 returned error can't find the container with id eab8739b08a5fd8c2b1292a322a63086b1404d96a1d857a7e81280dbfc57a5da Jul 15 05:06:50.677523 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:50.677488 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" event={"ID":"dd2af81d-7e51-4d82-ace0-73cf70b563ec","Type":"ContainerStarted","Data":"eab8739b08a5fd8c2b1292a322a63086b1404d96a1d857a7e81280dbfc57a5da"} Jul 15 05:06:58.715947 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:58.715906 2555 generic.go:356] "Generic (PLEG): container finished" podID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerID="45a8eb7c85b4be4ea277717eacf93b4b98abaaf636b4c27fa8f9f4d44ef324b3" exitCode=0 Jul 15 05:06:58.716323 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:06:58.715994 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" event={"ID":"dd2af81d-7e51-4d82-ace0-73cf70b563ec","Type":"ContainerDied","Data":"45a8eb7c85b4be4ea277717eacf93b4b98abaaf636b4c27fa8f9f4d44ef324b3"} Jul 15 05:07:01.733285 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:01.733252 2555 generic.go:356] "Generic (PLEG): container finished" podID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerID="1181d18c5ff45c4d3a284d4c799a85955c08d13d7537591cd2dec3d3988fbda1" exitCode=0 Jul 15 05:07:01.733664 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:01.733336 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" event={"ID":"dd2af81d-7e51-4d82-ace0-73cf70b563ec","Type":"ContainerDied","Data":"1181d18c5ff45c4d3a284d4c799a85955c08d13d7537591cd2dec3d3988fbda1"} Jul 15 05:07:09.773280 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:09.773245 2555 generic.go:356] "Generic (PLEG): container finished" podID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerID="90c04f9773c9274cc34047160731414f978f4d5fcbff39afcf42d4fddf7eb818" exitCode=0 Jul 15 05:07:09.773705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:09.773318 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" event={"ID":"dd2af81d-7e51-4d82-ace0-73cf70b563ec","Type":"ContainerDied","Data":"90c04f9773c9274cc34047160731414f978f4d5fcbff39afcf42d4fddf7eb818"} Jul 15 05:07:10.953016 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:10.952983 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:07:10.969967 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:10.969940 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7v7g\" (UniqueName: \"kubernetes.io/projected/dd2af81d-7e51-4d82-ace0-73cf70b563ec-kube-api-access-p7v7g\") pod \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " Jul 15 05:07:10.969967 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:10.969978 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-bundle\") pod \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " Jul 15 05:07:10.969967 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:10.970047 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-util\") pod \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\" (UID: \"dd2af81d-7e51-4d82-ace0-73cf70b563ec\") " Jul 15 05:07:10.971211 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:10.971141 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-bundle" (OuterVolumeSpecName: "bundle") pod "dd2af81d-7e51-4d82-ace0-73cf70b563ec" (UID: "dd2af81d-7e51-4d82-ace0-73cf70b563ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:07:10.972663 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:10.972634 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd2af81d-7e51-4d82-ace0-73cf70b563ec-kube-api-access-p7v7g" (OuterVolumeSpecName: "kube-api-access-p7v7g") pod "dd2af81d-7e51-4d82-ace0-73cf70b563ec" (UID: "dd2af81d-7e51-4d82-ace0-73cf70b563ec"). InnerVolumeSpecName "kube-api-access-p7v7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:07:10.975103 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:10.975074 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-util" (OuterVolumeSpecName: "util") pod "dd2af81d-7e51-4d82-ace0-73cf70b563ec" (UID: "dd2af81d-7e51-4d82-ace0-73cf70b563ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:07:11.071291 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:11.071193 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-util\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:11.071291 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:11.071230 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7v7g\" (UniqueName: \"kubernetes.io/projected/dd2af81d-7e51-4d82-ace0-73cf70b563ec-kube-api-access-p7v7g\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:11.071291 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:11.071242 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd2af81d-7e51-4d82-ace0-73cf70b563ec-bundle\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:11.783826 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:11.783793 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" Jul 15 05:07:11.783971 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:11.783817 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409szcb" event={"ID":"dd2af81d-7e51-4d82-ace0-73cf70b563ec","Type":"ContainerDied","Data":"eab8739b08a5fd8c2b1292a322a63086b1404d96a1d857a7e81280dbfc57a5da"} Jul 15 05:07:11.783971 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:11.783871 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eab8739b08a5fd8c2b1292a322a63086b1404d96a1d857a7e81280dbfc57a5da" Jul 15 05:07:22.877139 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.877098 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v"] Jul 15 05:07:22.877616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.877426 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerName="pull" Jul 15 05:07:22.877616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.877439 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerName="pull" Jul 15 05:07:22.877616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.877455 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerName="util" Jul 15 05:07:22.877616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.877460 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerName="util" Jul 15 05:07:22.877616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.877470 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerName="extract" Jul 15 05:07:22.877616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.877489 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerName="extract" Jul 15 05:07:22.877616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.877547 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd2af81d-7e51-4d82-ace0-73cf70b563ec" containerName="extract" Jul 15 05:07:22.879838 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.879815 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:22.883717 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.883688 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 05:07:22.883924 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.883905 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6k4b7\"" Jul 15 05:07:22.884754 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.884715 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 05:07:22.902479 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.902450 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v"] Jul 15 05:07:22.967402 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.967366 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:22.967591 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.967417 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:22.967591 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:22.967506 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf7hz\" (UniqueName: \"kubernetes.io/projected/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-kube-api-access-xf7hz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:23.067957 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.067917 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf7hz\" (UniqueName: \"kubernetes.io/projected/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-kube-api-access-xf7hz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:23.068130 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.067984 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:23.068130 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.068012 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:23.068391 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.068374 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:23.068465 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.068445 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:23.078084 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.078060 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf7hz\" (UniqueName: \"kubernetes.io/projected/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-kube-api-access-xf7hz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:23.191011 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.190919 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:23.335027 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.334960 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v"] Jul 15 05:07:23.337919 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:07:23.337887 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b10e1da_fefe_4eea_ae19_0103fb2fdfb7.slice/crio-d34d6ed86a4d577646a07bed003cffd16d2968671d9b0daddb5ddf272e997076 WatchSource:0}: Error finding container d34d6ed86a4d577646a07bed003cffd16d2968671d9b0daddb5ddf272e997076: Status 404 returned error can't find the container with id d34d6ed86a4d577646a07bed003cffd16d2968671d9b0daddb5ddf272e997076 Jul 15 05:07:23.833234 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.833199 2555 generic.go:356] "Generic (PLEG): container finished" podID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerID="6604d6fe6c7d8e006233da9c9e34df0232aa0fe06db4b31e44a5ccd0333fd7a9" exitCode=0 Jul 15 05:07:23.833409 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.833282 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" event={"ID":"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7","Type":"ContainerDied","Data":"6604d6fe6c7d8e006233da9c9e34df0232aa0fe06db4b31e44a5ccd0333fd7a9"} Jul 15 05:07:23.833409 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:23.833337 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" event={"ID":"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7","Type":"ContainerStarted","Data":"d34d6ed86a4d577646a07bed003cffd16d2968671d9b0daddb5ddf272e997076"} Jul 15 05:07:24.476855 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.476816 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk"] Jul 15 05:07:24.479099 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.479079 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" Jul 15 05:07:24.481863 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.481840 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 05:07:24.481978 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.481884 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ktvxs\"" Jul 15 05:07:24.481978 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.481954 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 05:07:24.492711 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.492634 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk"] Jul 15 05:07:24.580594 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.580560 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/447a37b0-dea7-4aa6-aac9-149bd93552bf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pq6lk\" (UID: \"447a37b0-dea7-4aa6-aac9-149bd93552bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" Jul 15 05:07:24.580837 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.580613 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t744z\" (UniqueName: \"kubernetes.io/projected/447a37b0-dea7-4aa6-aac9-149bd93552bf-kube-api-access-t744z\") pod \"cert-manager-cainjector-559cdd8c87-pq6lk\" (UID: \"447a37b0-dea7-4aa6-aac9-149bd93552bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" Jul 15 05:07:24.644881 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.644842 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8v89f"] Jul 15 05:07:24.647807 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.647778 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:24.650433 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.650404 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kk6gm\"" Jul 15 05:07:24.658535 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.658505 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8v89f"] Jul 15 05:07:24.681401 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.681367 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t744z\" (UniqueName: \"kubernetes.io/projected/447a37b0-dea7-4aa6-aac9-149bd93552bf-kube-api-access-t744z\") pod \"cert-manager-cainjector-559cdd8c87-pq6lk\" (UID: \"447a37b0-dea7-4aa6-aac9-149bd93552bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" Jul 15 05:07:24.681601 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.681461 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/447a37b0-dea7-4aa6-aac9-149bd93552bf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pq6lk\" (UID: \"447a37b0-dea7-4aa6-aac9-149bd93552bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" Jul 15 05:07:24.681601 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.681491 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26eaa9d9-9913-4f08-8212-a0506109e2d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8v89f\" (UID: \"26eaa9d9-9913-4f08-8212-a0506109e2d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:24.681601 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.681512 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rtgz\" (UniqueName: \"kubernetes.io/projected/26eaa9d9-9913-4f08-8212-a0506109e2d9-kube-api-access-5rtgz\") pod \"cert-manager-webhook-6486ffd997-8v89f\" (UID: \"26eaa9d9-9913-4f08-8212-a0506109e2d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:24.690102 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.690070 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/447a37b0-dea7-4aa6-aac9-149bd93552bf-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pq6lk\" (UID: \"447a37b0-dea7-4aa6-aac9-149bd93552bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" Jul 15 05:07:24.690266 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.690248 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t744z\" (UniqueName: \"kubernetes.io/projected/447a37b0-dea7-4aa6-aac9-149bd93552bf-kube-api-access-t744z\") pod \"cert-manager-cainjector-559cdd8c87-pq6lk\" (UID: \"447a37b0-dea7-4aa6-aac9-149bd93552bf\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" Jul 15 05:07:24.782616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.782531 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26eaa9d9-9913-4f08-8212-a0506109e2d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8v89f\" (UID: \"26eaa9d9-9913-4f08-8212-a0506109e2d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:24.782616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.782576 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rtgz\" (UniqueName: \"kubernetes.io/projected/26eaa9d9-9913-4f08-8212-a0506109e2d9-kube-api-access-5rtgz\") pod \"cert-manager-webhook-6486ffd997-8v89f\" (UID: \"26eaa9d9-9913-4f08-8212-a0506109e2d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:24.794480 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.794448 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26eaa9d9-9913-4f08-8212-a0506109e2d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-8v89f\" (UID: \"26eaa9d9-9913-4f08-8212-a0506109e2d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:24.794648 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.794531 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rtgz\" (UniqueName: \"kubernetes.io/projected/26eaa9d9-9913-4f08-8212-a0506109e2d9-kube-api-access-5rtgz\") pod \"cert-manager-webhook-6486ffd997-8v89f\" (UID: \"26eaa9d9-9913-4f08-8212-a0506109e2d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:24.800177 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.800137 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" Jul 15 05:07:24.955208 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.955180 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk"] Jul 15 05:07:24.957811 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:07:24.957784 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod447a37b0_dea7_4aa6_aac9_149bd93552bf.slice/crio-267b88d7f32b5ca8a595a5a9a354f7e7222c8823ce5140ae912147c3eb6b7d8b WatchSource:0}: Error finding container 267b88d7f32b5ca8a595a5a9a354f7e7222c8823ce5140ae912147c3eb6b7d8b: Status 404 returned error can't find the container with id 267b88d7f32b5ca8a595a5a9a354f7e7222c8823ce5140ae912147c3eb6b7d8b Jul 15 05:07:24.959664 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:24.959646 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:25.096233 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:25.096204 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-8v89f"] Jul 15 05:07:25.098720 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:07:25.098691 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26eaa9d9_9913_4f08_8212_a0506109e2d9.slice/crio-c89c2a6a3937ae37732bc4325cc3da074dd9698c1f85e7d746cc7976228a6070 WatchSource:0}: Error finding container c89c2a6a3937ae37732bc4325cc3da074dd9698c1f85e7d746cc7976228a6070: Status 404 returned error can't find the container with id c89c2a6a3937ae37732bc4325cc3da074dd9698c1f85e7d746cc7976228a6070 Jul 15 05:07:25.850754 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:25.850700 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" event={"ID":"26eaa9d9-9913-4f08-8212-a0506109e2d9","Type":"ContainerStarted","Data":"c89c2a6a3937ae37732bc4325cc3da074dd9698c1f85e7d746cc7976228a6070"} Jul 15 05:07:25.851827 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:25.851804 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" event={"ID":"447a37b0-dea7-4aa6-aac9-149bd93552bf","Type":"ContainerStarted","Data":"267b88d7f32b5ca8a595a5a9a354f7e7222c8823ce5140ae912147c3eb6b7d8b"} Jul 15 05:07:27.864420 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:27.864384 2555 generic.go:356] "Generic (PLEG): container finished" podID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerID="03aedc057de66553ed2e453e6775c7919caefb3208f78a910663ea1735e4a4c6" exitCode=0 Jul 15 05:07:27.864935 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:27.864466 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" event={"ID":"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7","Type":"ContainerDied","Data":"03aedc057de66553ed2e453e6775c7919caefb3208f78a910663ea1735e4a4c6"} Jul 15 05:07:28.872118 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:28.872077 2555 generic.go:356] "Generic (PLEG): container finished" podID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerID="72532bae6744757c1d28b68d70e639c52c0d02424115ef40a860597e5fd5aa65" exitCode=0 Jul 15 05:07:28.872530 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:28.872168 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" event={"ID":"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7","Type":"ContainerDied","Data":"72532bae6744757c1d28b68d70e639c52c0d02424115ef40a860597e5fd5aa65"} Jul 15 05:07:29.878599 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:29.878562 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" event={"ID":"447a37b0-dea7-4aa6-aac9-149bd93552bf","Type":"ContainerStarted","Data":"e9ae3101aa9aa0b8700f305f15d437715bc9688dcc0091fce1a08ae3dc0981e1"} Jul 15 05:07:29.880167 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:29.880128 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" event={"ID":"26eaa9d9-9913-4f08-8212-a0506109e2d9","Type":"ContainerStarted","Data":"149c6a1ed96f4aed867a063f2d1b49b594725238b59df601841e2b4d8836d04e"} Jul 15 05:07:29.880362 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:29.880345 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:29.896519 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:29.896455 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pq6lk" podStartSLOduration=1.6335930749999998 podStartE2EDuration="5.896433972s" totalImagesPullingTime="4.262840897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:07:29.894370664 +0000 UTC m=+534.628030814" watchObservedRunningTime="2026-07-15 05:07:29.896433972 +0000 UTC m=+534.630094122" Jul 15 05:07:29.915851 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:29.915793 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" podStartSLOduration=1.800594507 podStartE2EDuration="5.915773987s" totalImagesPullingTime="4.11517948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:07:29.912295485 +0000 UTC m=+534.645955646" watchObservedRunningTime="2026-07-15 05:07:29.915773987 +0000 UTC m=+534.649434135" Jul 15 05:07:30.020624 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.020593 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:30.130747 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.130639 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf7hz\" (UniqueName: \"kubernetes.io/projected/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-kube-api-access-xf7hz\") pod \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " Jul 15 05:07:30.130747 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.130687 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-util\") pod \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " Jul 15 05:07:30.130747 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.130712 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-bundle\") pod \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\" (UID: \"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7\") " Jul 15 05:07:30.131112 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.131088 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-bundle" (OuterVolumeSpecName: "bundle") pod "0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" (UID: "0b10e1da-fefe-4eea-ae19-0103fb2fdfb7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:07:30.132869 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.132846 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-kube-api-access-xf7hz" (OuterVolumeSpecName: "kube-api-access-xf7hz") pod "0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" (UID: "0b10e1da-fefe-4eea-ae19-0103fb2fdfb7"). InnerVolumeSpecName "kube-api-access-xf7hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:07:30.135208 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.135180 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-util" (OuterVolumeSpecName: "util") pod "0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" (UID: "0b10e1da-fefe-4eea-ae19-0103fb2fdfb7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:07:30.231538 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.231500 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf7hz\" (UniqueName: \"kubernetes.io/projected/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-kube-api-access-xf7hz\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:30.231708 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.231557 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-util\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:30.231708 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.231569 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0b10e1da-fefe-4eea-ae19-0103fb2fdfb7-bundle\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:30.886933 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.886898 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" Jul 15 05:07:30.887344 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.886927 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjr7v" event={"ID":"0b10e1da-fefe-4eea-ae19-0103fb2fdfb7","Type":"ContainerDied","Data":"d34d6ed86a4d577646a07bed003cffd16d2968671d9b0daddb5ddf272e997076"} Jul 15 05:07:30.887344 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:30.886977 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d34d6ed86a4d577646a07bed003cffd16d2968671d9b0daddb5ddf272e997076" Jul 15 05:07:35.455349 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.455312 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb"] Jul 15 05:07:35.455784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.455641 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerName="util" Jul 15 05:07:35.455784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.455654 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerName="util" Jul 15 05:07:35.455784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.455662 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerName="pull" Jul 15 05:07:35.455784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.455669 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerName="pull" Jul 15 05:07:35.455784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.455686 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerName="extract" Jul 15 05:07:35.455784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.455693 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerName="extract" Jul 15 05:07:35.455784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.455763 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b10e1da-fefe-4eea-ae19-0103fb2fdfb7" containerName="extract" Jul 15 05:07:35.510476 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.510438 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb"] Jul 15 05:07:35.510620 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.510564 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" Jul 15 05:07:35.512816 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.512795 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 05:07:35.512908 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.512817 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vk62l\"" Jul 15 05:07:35.513548 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.513528 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 05:07:35.580098 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.580054 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrwkl\" (UniqueName: \"kubernetes.io/projected/d51e7cef-4e0e-4308-939b-01c019859500-kube-api-access-rrwkl\") pod \"openshift-lws-operator-fd8ccff4c-wqbtb\" (UID: \"d51e7cef-4e0e-4308-939b-01c019859500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" Jul 15 05:07:35.580098 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.580104 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d51e7cef-4e0e-4308-939b-01c019859500-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wqbtb\" (UID: \"d51e7cef-4e0e-4308-939b-01c019859500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" Jul 15 05:07:35.681067 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.681030 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrwkl\" (UniqueName: \"kubernetes.io/projected/d51e7cef-4e0e-4308-939b-01c019859500-kube-api-access-rrwkl\") pod \"openshift-lws-operator-fd8ccff4c-wqbtb\" (UID: \"d51e7cef-4e0e-4308-939b-01c019859500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" Jul 15 05:07:35.681246 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.681077 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d51e7cef-4e0e-4308-939b-01c019859500-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wqbtb\" (UID: \"d51e7cef-4e0e-4308-939b-01c019859500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" Jul 15 05:07:35.681510 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.681489 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d51e7cef-4e0e-4308-939b-01c019859500-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wqbtb\" (UID: \"d51e7cef-4e0e-4308-939b-01c019859500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" Jul 15 05:07:35.692057 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.692030 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 05:07:35.702257 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.702238 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 05:07:35.713307 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.713242 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrwkl\" (UniqueName: \"kubernetes.io/projected/d51e7cef-4e0e-4308-939b-01c019859500-kube-api-access-rrwkl\") pod \"openshift-lws-operator-fd8ccff4c-wqbtb\" (UID: \"d51e7cef-4e0e-4308-939b-01c019859500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" Jul 15 05:07:35.821411 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.821381 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vk62l\"" Jul 15 05:07:35.829343 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.829319 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" Jul 15 05:07:35.991190 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:35.990957 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb"] Jul 15 05:07:35.993838 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:07:35.993809 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd51e7cef_4e0e_4308_939b_01c019859500.slice/crio-750786465ed04668076033bd666a0881c4e768e8c6407e7dd60998d5f14b02f4 WatchSource:0}: Error finding container 750786465ed04668076033bd666a0881c4e768e8c6407e7dd60998d5f14b02f4: Status 404 returned error can't find the container with id 750786465ed04668076033bd666a0881c4e768e8c6407e7dd60998d5f14b02f4 Jul 15 05:07:36.894288 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:36.894258 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-8v89f" Jul 15 05:07:36.915642 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:36.915598 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" event={"ID":"d51e7cef-4e0e-4308-939b-01c019859500","Type":"ContainerStarted","Data":"750786465ed04668076033bd666a0881c4e768e8c6407e7dd60998d5f14b02f4"} Jul 15 05:07:42.945585 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:42.945543 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" event={"ID":"d51e7cef-4e0e-4308-939b-01c019859500","Type":"ContainerStarted","Data":"c5eb0eb2aed2b6253b4395b1de3ed771c94de7105dc7621381233f500acd5996"} Jul 15 05:07:42.964137 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:42.964077 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wqbtb" podStartSLOduration=1.94185702 podStartE2EDuration="7.964057415s" totalImagesPullingTime="6.022200395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:07:42.961820928 +0000 UTC m=+547.695481071" watchObservedRunningTime="2026-07-15 05:07:42.964057415 +0000 UTC m=+547.697717563" Jul 15 05:07:45.751825 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.751793 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc"] Jul 15 05:07:45.759518 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.759482 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.762220 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.762191 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 05:07:45.762350 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.762198 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 05:07:45.762350 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.762286 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6k4b7\"" Jul 15 05:07:45.765565 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.765487 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc"] Jul 15 05:07:45.879062 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.878998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.879274 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.879115 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.879274 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.879181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrkb\" (UniqueName: \"kubernetes.io/projected/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-kube-api-access-5wrkb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.980169 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.980129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrkb\" (UniqueName: \"kubernetes.io/projected/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-kube-api-access-5wrkb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.980379 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.980183 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.980379 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.980231 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.980576 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.980552 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.980576 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.980573 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:45.989115 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:45.989081 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrkb\" (UniqueName: \"kubernetes.io/projected/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-kube-api-access-5wrkb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:46.070014 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:46.069920 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:46.203468 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:46.203442 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc"] Jul 15 05:07:46.205908 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:07:46.205879 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode544ffd5_e14c_40ca_b4ca_42e370fcfaa7.slice/crio-aeee64d7fea9a9c0b0051c3f8d4a67067a8f9a350f28a81556c956b28f19b075 WatchSource:0}: Error finding container aeee64d7fea9a9c0b0051c3f8d4a67067a8f9a350f28a81556c956b28f19b075: Status 404 returned error can't find the container with id aeee64d7fea9a9c0b0051c3f8d4a67067a8f9a350f28a81556c956b28f19b075 Jul 15 05:07:46.965070 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:46.965035 2555 generic.go:356] "Generic (PLEG): container finished" podID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerID="f2d80ee3bcf289027b07e9e0cec6cd8b01d372a429db071e031f1018812bb465" exitCode=0 Jul 15 05:07:46.965480 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:46.965129 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" event={"ID":"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7","Type":"ContainerDied","Data":"f2d80ee3bcf289027b07e9e0cec6cd8b01d372a429db071e031f1018812bb465"} Jul 15 05:07:46.965480 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:46.965199 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" event={"ID":"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7","Type":"ContainerStarted","Data":"aeee64d7fea9a9c0b0051c3f8d4a67067a8f9a350f28a81556c956b28f19b075"} Jul 15 05:07:47.971853 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:47.971821 2555 generic.go:356] "Generic (PLEG): container finished" podID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerID="0656a38c4eefa60a8dd8a65f2c9c6102907d29890799b3c5b8dd8f2d2b11a509" exitCode=0 Jul 15 05:07:47.972246 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:47.971873 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" event={"ID":"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7","Type":"ContainerDied","Data":"0656a38c4eefa60a8dd8a65f2c9c6102907d29890799b3c5b8dd8f2d2b11a509"} Jul 15 05:07:48.979009 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:48.978970 2555 generic.go:356] "Generic (PLEG): container finished" podID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerID="5dfaed49a51a49b9f985eaa6a47adfb1cba44f752a17188fd4aceea04efa7b68" exitCode=0 Jul 15 05:07:48.979384 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:48.979053 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" event={"ID":"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7","Type":"ContainerDied","Data":"5dfaed49a51a49b9f985eaa6a47adfb1cba44f752a17188fd4aceea04efa7b68"} Jul 15 05:07:50.123880 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.123847 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:50.218480 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.218440 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-bundle\") pod \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " Jul 15 05:07:50.218480 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.218482 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-util\") pod \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " Jul 15 05:07:50.218688 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.218530 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrkb\" (UniqueName: \"kubernetes.io/projected/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-kube-api-access-5wrkb\") pod \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\" (UID: \"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7\") " Jul 15 05:07:50.219177 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.219151 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-bundle" (OuterVolumeSpecName: "bundle") pod "e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" (UID: "e544ffd5-e14c-40ca-b4ca-42e370fcfaa7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:07:50.220708 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.220676 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-kube-api-access-5wrkb" (OuterVolumeSpecName: "kube-api-access-5wrkb") pod "e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" (UID: "e544ffd5-e14c-40ca-b4ca-42e370fcfaa7"). InnerVolumeSpecName "kube-api-access-5wrkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:07:50.224085 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.224048 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-util" (OuterVolumeSpecName: "util") pod "e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" (UID: "e544ffd5-e14c-40ca-b4ca-42e370fcfaa7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:07:50.319389 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.319293 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-bundle\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:50.319389 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.319343 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-util\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:50.319389 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.319358 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wrkb\" (UniqueName: \"kubernetes.io/projected/e544ffd5-e14c-40ca-b4ca-42e370fcfaa7-kube-api-access-5wrkb\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:07:50.990701 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.990668 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" event={"ID":"e544ffd5-e14c-40ca-b4ca-42e370fcfaa7","Type":"ContainerDied","Data":"aeee64d7fea9a9c0b0051c3f8d4a67067a8f9a350f28a81556c956b28f19b075"} Jul 15 05:07:50.990892 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.990719 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aeee64d7fea9a9c0b0051c3f8d4a67067a8f9a350f28a81556c956b28f19b075" Jul 15 05:07:50.990892 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:50.990675 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgnqfc" Jul 15 05:07:55.750159 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.750120 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr"] Jul 15 05:07:55.750560 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.750458 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerName="util" Jul 15 05:07:55.750560 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.750469 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerName="util" Jul 15 05:07:55.750560 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.750486 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerName="extract" Jul 15 05:07:55.750560 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.750492 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerName="extract" Jul 15 05:07:55.750560 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.750502 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerName="pull" Jul 15 05:07:55.750560 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.750507 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerName="pull" Jul 15 05:07:55.750560 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.750562 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e544ffd5-e14c-40ca-b4ca-42e370fcfaa7" containerName="extract" Jul 15 05:07:55.752814 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.752787 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.755330 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.755299 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 15 05:07:55.755593 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.755570 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 15 05:07:55.756013 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.755955 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 15 05:07:55.756152 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.756025 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v8jgz\"" Jul 15 05:07:55.764472 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.764449 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23d12890-f2bd-4110-b477-02b5c02e0598-cert\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.764582 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.764482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23d12890-f2bd-4110-b477-02b5c02e0598-metrics-cert\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.764582 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.764501 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdmxd\" (UniqueName: \"kubernetes.io/projected/23d12890-f2bd-4110-b477-02b5c02e0598-kube-api-access-kdmxd\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.764668 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.764591 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23d12890-f2bd-4110-b477-02b5c02e0598-manager-config\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.770923 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.770892 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr"] Jul 15 05:07:55.865932 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.865889 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23d12890-f2bd-4110-b477-02b5c02e0598-cert\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.865932 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.865933 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23d12890-f2bd-4110-b477-02b5c02e0598-metrics-cert\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.866176 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.865967 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdmxd\" (UniqueName: \"kubernetes.io/projected/23d12890-f2bd-4110-b477-02b5c02e0598-kube-api-access-kdmxd\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.866176 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.866025 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23d12890-f2bd-4110-b477-02b5c02e0598-manager-config\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.867031 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.867002 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/23d12890-f2bd-4110-b477-02b5c02e0598-manager-config\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.868843 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.868821 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/23d12890-f2bd-4110-b477-02b5c02e0598-cert\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.868937 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.868875 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/23d12890-f2bd-4110-b477-02b5c02e0598-metrics-cert\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:55.884314 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:55.884280 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdmxd\" (UniqueName: \"kubernetes.io/projected/23d12890-f2bd-4110-b477-02b5c02e0598-kube-api-access-kdmxd\") pod \"lws-controller-manager-8fd856859-h6kcr\" (UID: \"23d12890-f2bd-4110-b477-02b5c02e0598\") " pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:56.062199 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:56.062111 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:56.252360 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:56.252330 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr"] Jul 15 05:07:56.254310 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:07:56.254281 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d12890_f2bd_4110_b477_02b5c02e0598.slice/crio-fb62e5dc53f124c08ad14640c0280e98f352656b32e3f0ec637541d24a30cc47 WatchSource:0}: Error finding container fb62e5dc53f124c08ad14640c0280e98f352656b32e3f0ec637541d24a30cc47: Status 404 returned error can't find the container with id fb62e5dc53f124c08ad14640c0280e98f352656b32e3f0ec637541d24a30cc47 Jul 15 05:07:57.021616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:57.021571 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" event={"ID":"23d12890-f2bd-4110-b477-02b5c02e0598","Type":"ContainerStarted","Data":"fb62e5dc53f124c08ad14640c0280e98f352656b32e3f0ec637541d24a30cc47"} Jul 15 05:07:59.032673 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:59.032631 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" event={"ID":"23d12890-f2bd-4110-b477-02b5c02e0598","Type":"ContainerStarted","Data":"1e6bdce9062992270bb2ebd158ab831c5c8d30c4d886569f7b3d30c14f9862c4"} Jul 15 05:07:59.033081 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:59.032751 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:07:59.051243 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:07:59.051186 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" podStartSLOduration=1.781576529 podStartE2EDuration="4.051167857s" totalImagesPullingTime="2.269591328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:07:59.049516286 +0000 UTC m=+563.783176435" watchObservedRunningTime="2026-07-15 05:07:59.051167857 +0000 UTC m=+563.784828060" Jul 15 05:08:03.504006 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.503976 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r"] Jul 15 05:08:03.507622 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.507603 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.516802 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.516772 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 05:08:03.517506 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.517487 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 05:08:03.518470 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.518449 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-k6dtd\"" Jul 15 05:08:03.518881 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.518866 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 05:08:03.519853 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.519839 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 05:08:03.531150 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.531122 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adcb73f7-8788-43a6-9241-84de48aa1764-webhook-cert\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.531262 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.531166 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p9lk\" (UniqueName: \"kubernetes.io/projected/adcb73f7-8788-43a6-9241-84de48aa1764-kube-api-access-5p9lk\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.531262 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.531196 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adcb73f7-8788-43a6-9241-84de48aa1764-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.531262 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.531247 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adcb73f7-8788-43a6-9241-84de48aa1764-manifests\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.531376 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.531318 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcb73f7-8788-43a6-9241-84de48aa1764-tmp\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.544211 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.544171 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r"] Jul 15 05:08:03.632754 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.632675 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adcb73f7-8788-43a6-9241-84de48aa1764-webhook-cert\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.632956 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.632777 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9lk\" (UniqueName: \"kubernetes.io/projected/adcb73f7-8788-43a6-9241-84de48aa1764-kube-api-access-5p9lk\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.632956 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.632808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adcb73f7-8788-43a6-9241-84de48aa1764-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.632956 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.632837 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adcb73f7-8788-43a6-9241-84de48aa1764-manifests\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.632956 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.632875 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcb73f7-8788-43a6-9241-84de48aa1764-tmp\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.633368 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.633336 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/adcb73f7-8788-43a6-9241-84de48aa1764-manifests\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.635119 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.635096 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adcb73f7-8788-43a6-9241-84de48aa1764-tmp\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.635459 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.635437 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/adcb73f7-8788-43a6-9241-84de48aa1764-apiservice-cert\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.635576 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.635553 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/adcb73f7-8788-43a6-9241-84de48aa1764-webhook-cert\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.648450 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.648414 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p9lk\" (UniqueName: \"kubernetes.io/projected/adcb73f7-8788-43a6-9241-84de48aa1764-kube-api-access-5p9lk\") pod \"opendatahub-operator-controller-manager-749c75689b-cm76r\" (UID: \"adcb73f7-8788-43a6-9241-84de48aa1764\") " pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.819453 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.819365 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:03.970956 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:03.970931 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r"] Jul 15 05:08:03.973206 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:08:03.973180 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadcb73f7_8788_43a6_9241_84de48aa1764.slice/crio-31debd7880531aae53e087f8cd9429580f95e46e946f64ffb0667fef3f4c7a0c WatchSource:0}: Error finding container 31debd7880531aae53e087f8cd9429580f95e46e946f64ffb0667fef3f4c7a0c: Status 404 returned error can't find the container with id 31debd7880531aae53e087f8cd9429580f95e46e946f64ffb0667fef3f4c7a0c Jul 15 05:08:04.056226 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:04.056192 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" event={"ID":"adcb73f7-8788-43a6-9241-84de48aa1764","Type":"ContainerStarted","Data":"31debd7880531aae53e087f8cd9429580f95e46e946f64ffb0667fef3f4c7a0c"} Jul 15 05:08:07.076152 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:07.076109 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" event={"ID":"adcb73f7-8788-43a6-9241-84de48aa1764","Type":"ContainerStarted","Data":"f918e7cd6c53f8e9f124910b6f5cc5962cea8087b3d67f23c719756d320d97f3"} Jul 15 05:08:09.087758 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:09.087703 2555 generic.go:356] "Generic (PLEG): container finished" podID="adcb73f7-8788-43a6-9241-84de48aa1764" containerID="f918e7cd6c53f8e9f124910b6f5cc5962cea8087b3d67f23c719756d320d97f3" exitCode=0 Jul 15 05:08:09.087758 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:09.087752 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" event={"ID":"adcb73f7-8788-43a6-9241-84de48aa1764","Type":"ContainerDied","Data":"f918e7cd6c53f8e9f124910b6f5cc5962cea8087b3d67f23c719756d320d97f3"} Jul 15 05:08:10.040421 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:10.040386 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8fd856859-h6kcr" Jul 15 05:08:10.095644 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:10.095606 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" event={"ID":"adcb73f7-8788-43a6-9241-84de48aa1764","Type":"ContainerStarted","Data":"151ace30f874b1f49114c42b36fb10d0ca22b96d382be90432a8d7a45eb46320"} Jul 15 05:08:10.096094 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:10.095967 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:10.117114 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:10.117053 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" podStartSLOduration=2.691441761 podStartE2EDuration="7.11703749s" totalImagesPullingTime="3.301837951s" totalInitContainerRuntime="1.123757778s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:08:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:08:10.114703642 +0000 UTC m=+574.848363834" watchObservedRunningTime="2026-07-15 05:08:10.11703749 +0000 UTC m=+574.850697639" Jul 15 05:08:21.103080 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:21.103046 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-749c75689b-cm76r" Jul 15 05:08:32.596442 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.596400 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh"] Jul 15 05:08:32.598908 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.598890 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.601315 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.601296 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 05:08:32.601421 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.601333 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 05:08:32.601737 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.601696 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 05:08:32.601737 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.601712 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-m9cmb\"" Jul 15 05:08:32.601966 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.601953 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 05:08:32.613991 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.613967 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh"] Jul 15 05:08:32.705051 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.705005 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd7cee40-5215-465d-ad65-ae6144c99ac4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.705051 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.705050 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.705297 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.705140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.705297 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.705194 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.705297 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.705213 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.705297 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.705286 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.705457 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.705316 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6vn9\" (UniqueName: \"kubernetes.io/projected/cd7cee40-5215-465d-ad65-ae6144c99ac4-kube-api-access-p6vn9\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.806516 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.806477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.806516 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.806520 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.806763 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.806546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.806763 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.806604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.806763 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.806644 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6vn9\" (UniqueName: \"kubernetes.io/projected/cd7cee40-5215-465d-ad65-ae6144c99ac4-kube-api-access-p6vn9\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.806763 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.806677 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd7cee40-5215-465d-ad65-ae6144c99ac4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.806763 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.806700 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.807377 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.807347 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.809209 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.809171 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.809209 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.809199 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd7cee40-5215-465d-ad65-ae6144c99ac4-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.809391 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.809272 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.809448 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.809401 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/cd7cee40-5215-465d-ad65-ae6144c99ac4-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.815229 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.815208 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd7cee40-5215-465d-ad65-ae6144c99ac4-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.815594 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.815574 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6vn9\" (UniqueName: \"kubernetes.io/projected/cd7cee40-5215-465d-ad65-ae6144c99ac4-kube-api-access-p6vn9\") pod \"istiod-openshift-gateway-94bb8fbfd-l22bh\" (UID: \"cd7cee40-5215-465d-ad65-ae6144c99ac4\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:32.909106 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:32.909019 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:33.057852 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:33.057817 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh"] Jul 15 05:08:33.061497 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:08:33.061456 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7cee40_5215_465d_ad65_ae6144c99ac4.slice/crio-4e53937bcf2f926a85eab8eb59d54a79df5ca9fc1276f3e12e4fb71925697c6a WatchSource:0}: Error finding container 4e53937bcf2f926a85eab8eb59d54a79df5ca9fc1276f3e12e4fb71925697c6a: Status 404 returned error can't find the container with id 4e53937bcf2f926a85eab8eb59d54a79df5ca9fc1276f3e12e4fb71925697c6a Jul 15 05:08:33.220425 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:33.220335 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" event={"ID":"cd7cee40-5215-465d-ad65-ae6144c99ac4","Type":"ContainerStarted","Data":"4e53937bcf2f926a85eab8eb59d54a79df5ca9fc1276f3e12e4fb71925697c6a"} Jul 15 05:08:35.719812 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:35.719783 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:08:35.720599 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:35.720577 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:08:35.728276 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:35.728248 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:08:35.728995 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:35.728969 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:08:38.315414 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:38.296463 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 05:08:38.315414 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:38.296539 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 05:08:39.256844 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:39.256795 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" event={"ID":"cd7cee40-5215-465d-ad65-ae6144c99ac4","Type":"ContainerStarted","Data":"ab472e8d55dbc70fc0723e7b3c773e20e950e06306e43d31fadd71c52167c32c"} Jul 15 05:08:39.257019 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:39.256936 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:08:39.258709 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:39.258680 2555 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-l22bh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 05:08:39.258866 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:39.258745 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" podUID="cd7cee40-5215-465d-ad65-ae6144c99ac4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 05:08:39.279853 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:39.279800 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" podStartSLOduration=2.047461544 podStartE2EDuration="7.279785271s" totalImagesPullingTime="5.232323727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:08:39.276376663 +0000 UTC m=+604.010036812" watchObservedRunningTime="2026-07-15 05:08:39.279785271 +0000 UTC m=+604.013445419" Jul 15 05:08:40.262377 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:08:40.262347 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-l22bh" Jul 15 05:09:40.185798 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.185759 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl"] Jul 15 05:09:40.192928 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.192895 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.195606 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.195582 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 05:09:40.195775 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.195682 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 05:09:40.196407 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.196382 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-26c86\"" Jul 15 05:09:40.199477 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.199454 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl"] Jul 15 05:09:40.229386 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.229343 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.229554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.229394 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnjwh\" (UniqueName: \"kubernetes.io/projected/3859bc27-94bc-4db6-91c1-3d3d287458bf-kube-api-access-nnjwh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.229554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.229516 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.330945 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.330900 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.331128 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.330980 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.331128 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.331013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnjwh\" (UniqueName: \"kubernetes.io/projected/3859bc27-94bc-4db6-91c1-3d3d287458bf-kube-api-access-nnjwh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.331304 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.331284 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.331390 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.331368 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.339241 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.339211 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnjwh\" (UniqueName: \"kubernetes.io/projected/3859bc27-94bc-4db6-91c1-3d3d287458bf-kube-api-access-nnjwh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.503913 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.503825 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:40.643799 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.643773 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl"] Jul 15 05:09:40.646648 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:09:40.646623 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3859bc27_94bc_4db6_91c1_3d3d287458bf.slice/crio-0ce82f8869fa7da7eb3adf71902319e96deecc621db7cd299e5aef654cd091ec WatchSource:0}: Error finding container 0ce82f8869fa7da7eb3adf71902319e96deecc621db7cd299e5aef654cd091ec: Status 404 returned error can't find the container with id 0ce82f8869fa7da7eb3adf71902319e96deecc621db7cd299e5aef654cd091ec Jul 15 05:09:40.973307 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.973274 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87"] Jul 15 05:09:40.976902 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.976881 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:40.984311 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:40.984281 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87"] Jul 15 05:09:41.037859 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.037757 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.037859 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.037822 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdqrd\" (UniqueName: \"kubernetes.io/projected/7c5209b8-2e23-4481-b651-a47a4fbe20d0-kube-api-access-vdqrd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.038071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.037902 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.138994 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.138952 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdqrd\" (UniqueName: \"kubernetes.io/projected/7c5209b8-2e23-4481-b651-a47a4fbe20d0-kube-api-access-vdqrd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.139180 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.139011 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.139180 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.139070 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.139522 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.139500 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.139559 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.139523 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.150603 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.150566 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdqrd\" (UniqueName: \"kubernetes.io/projected/7c5209b8-2e23-4481-b651-a47a4fbe20d0-kube-api-access-vdqrd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.287326 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.287282 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:41.442948 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.442884 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87"] Jul 15 05:09:41.445426 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:09:41.445388 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5209b8_2e23_4481_b651_a47a4fbe20d0.slice/crio-fa7ab6f44e7932d7d1a76e18dcfc000792e208583c3d681cdc366c3216db62b0 WatchSource:0}: Error finding container fa7ab6f44e7932d7d1a76e18dcfc000792e208583c3d681cdc366c3216db62b0: Status 404 returned error can't find the container with id fa7ab6f44e7932d7d1a76e18dcfc000792e208583c3d681cdc366c3216db62b0 Jul 15 05:09:41.569233 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.569197 2555 generic.go:356] "Generic (PLEG): container finished" podID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerID="6ff23aa17fb4af57511d0541e90447d5998aaf32a23a48c8c9ded5f63337b45f" exitCode=0 Jul 15 05:09:41.569542 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.569279 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" event={"ID":"3859bc27-94bc-4db6-91c1-3d3d287458bf","Type":"ContainerDied","Data":"6ff23aa17fb4af57511d0541e90447d5998aaf32a23a48c8c9ded5f63337b45f"} Jul 15 05:09:41.569542 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.569342 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" event={"ID":"3859bc27-94bc-4db6-91c1-3d3d287458bf","Type":"ContainerStarted","Data":"0ce82f8869fa7da7eb3adf71902319e96deecc621db7cd299e5aef654cd091ec"} Jul 15 05:09:41.569959 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.569939 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 05:09:41.570982 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.570962 2555 generic.go:356] "Generic (PLEG): container finished" podID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerID="03e2295863963efd01281ae68979347544f271ea153dec3f0c4a7bc791c8b08d" exitCode=0 Jul 15 05:09:41.571065 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.571012 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" event={"ID":"7c5209b8-2e23-4481-b651-a47a4fbe20d0","Type":"ContainerDied","Data":"03e2295863963efd01281ae68979347544f271ea153dec3f0c4a7bc791c8b08d"} Jul 15 05:09:41.571065 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.571045 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" event={"ID":"7c5209b8-2e23-4481-b651-a47a4fbe20d0","Type":"ContainerStarted","Data":"fa7ab6f44e7932d7d1a76e18dcfc000792e208583c3d681cdc366c3216db62b0"} Jul 15 05:09:41.630740 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.630684 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt"] Jul 15 05:09:41.634413 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.634391 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.643473 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.643447 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt"] Jul 15 05:09:41.745131 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.745098 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.745345 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.745167 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgpzt\" (UniqueName: \"kubernetes.io/projected/953590f4-674f-4a7a-9db8-a73792f704e1-kube-api-access-sgpzt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.745345 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.745202 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.846430 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.846402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.846612 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.846591 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgpzt\" (UniqueName: \"kubernetes.io/projected/953590f4-674f-4a7a-9db8-a73792f704e1-kube-api-access-sgpzt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.846690 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.846641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.846919 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.846897 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.846973 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.846941 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.854621 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.854589 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgpzt\" (UniqueName: \"kubernetes.io/projected/953590f4-674f-4a7a-9db8-a73792f704e1-kube-api-access-sgpzt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.944126 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.944089 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:41.981611 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.981575 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt"] Jul 15 05:09:41.985659 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.985630 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:41.996658 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:41.995667 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt"] Jul 15 05:09:42.048411 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.048373 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q79gl\" (UniqueName: \"kubernetes.io/projected/f70e9dac-d102-4151-ba34-61718db1cde4-kube-api-access-q79gl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.048577 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.048490 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.048628 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.048606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.088470 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.088430 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt"] Jul 15 05:09:42.091496 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:09:42.091466 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953590f4_674f_4a7a_9db8_a73792f704e1.slice/crio-4122ca78400efea20ee2732a01ad39313e6758644adc71a4995ff725d7b6aecd WatchSource:0}: Error finding container 4122ca78400efea20ee2732a01ad39313e6758644adc71a4995ff725d7b6aecd: Status 404 returned error can't find the container with id 4122ca78400efea20ee2732a01ad39313e6758644adc71a4995ff725d7b6aecd Jul 15 05:09:42.149518 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.149495 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.149598 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.149547 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q79gl\" (UniqueName: \"kubernetes.io/projected/f70e9dac-d102-4151-ba34-61718db1cde4-kube-api-access-q79gl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.149648 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.149603 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.149970 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.149951 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.150014 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.149954 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.157432 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.157403 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q79gl\" (UniqueName: \"kubernetes.io/projected/f70e9dac-d102-4151-ba34-61718db1cde4-kube-api-access-q79gl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.296869 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.296825 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:42.513248 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.513217 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt"] Jul 15 05:09:42.578052 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.578024 2555 generic.go:356] "Generic (PLEG): container finished" podID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerID="b9c2910cd36cf08d0b937ea71f6ec4530162b51d41c37841390ba30292b1e2b5" exitCode=0 Jul 15 05:09:42.578260 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.578115 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" event={"ID":"7c5209b8-2e23-4481-b651-a47a4fbe20d0","Type":"ContainerDied","Data":"b9c2910cd36cf08d0b937ea71f6ec4530162b51d41c37841390ba30292b1e2b5"} Jul 15 05:09:42.579760 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.579721 2555 generic.go:356] "Generic (PLEG): container finished" podID="953590f4-674f-4a7a-9db8-a73792f704e1" containerID="69115834b164d019c8e6d4709657b32dd23d7c74e75c75928a616758de05ef0d" exitCode=0 Jul 15 05:09:42.579861 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.579816 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" event={"ID":"953590f4-674f-4a7a-9db8-a73792f704e1","Type":"ContainerDied","Data":"69115834b164d019c8e6d4709657b32dd23d7c74e75c75928a616758de05ef0d"} Jul 15 05:09:42.579906 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:42.579857 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" event={"ID":"953590f4-674f-4a7a-9db8-a73792f704e1","Type":"ContainerStarted","Data":"4122ca78400efea20ee2732a01ad39313e6758644adc71a4995ff725d7b6aecd"} Jul 15 05:09:42.584004 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:09:42.583968 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70e9dac_d102_4151_ba34_61718db1cde4.slice/crio-18ef5305a0aee4879eec9000ab9d5bd043df16f7fd7f4f3ef1bb49a1de202467 WatchSource:0}: Error finding container 18ef5305a0aee4879eec9000ab9d5bd043df16f7fd7f4f3ef1bb49a1de202467: Status 404 returned error can't find the container with id 18ef5305a0aee4879eec9000ab9d5bd043df16f7fd7f4f3ef1bb49a1de202467 Jul 15 05:09:43.588334 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.588304 2555 generic.go:356] "Generic (PLEG): container finished" podID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerID="63c1881056549687c174eb3733aff9287627a419add178792c55b8ae90d6f9d4" exitCode=0 Jul 15 05:09:43.588777 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.588395 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" event={"ID":"7c5209b8-2e23-4481-b651-a47a4fbe20d0","Type":"ContainerDied","Data":"63c1881056549687c174eb3733aff9287627a419add178792c55b8ae90d6f9d4"} Jul 15 05:09:43.590262 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.590241 2555 generic.go:356] "Generic (PLEG): container finished" podID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerID="dd069aaf6973d4a78ec22171aed91e0cde52fe0a336cb114e5eb6579709d42ba" exitCode=0 Jul 15 05:09:43.590400 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.590308 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" event={"ID":"3859bc27-94bc-4db6-91c1-3d3d287458bf","Type":"ContainerDied","Data":"dd069aaf6973d4a78ec22171aed91e0cde52fe0a336cb114e5eb6579709d42ba"} Jul 15 05:09:43.594113 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.592569 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" event={"ID":"953590f4-674f-4a7a-9db8-a73792f704e1","Type":"ContainerDied","Data":"bc4570053f7391cbb4c57e3512b75f570c331ed26ecacb47de6343ff032b9736"} Jul 15 05:09:43.594113 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.592237 2555 generic.go:356] "Generic (PLEG): container finished" podID="953590f4-674f-4a7a-9db8-a73792f704e1" containerID="bc4570053f7391cbb4c57e3512b75f570c331ed26ecacb47de6343ff032b9736" exitCode=0 Jul 15 05:09:43.600592 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.600569 2555 generic.go:356] "Generic (PLEG): container finished" podID="f70e9dac-d102-4151-ba34-61718db1cde4" containerID="3e3ecbd2eaa2d32b583594b079d6c6f78c9de29f8fc12d6152470a0aa6eae0ff" exitCode=0 Jul 15 05:09:43.600690 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.600612 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" event={"ID":"f70e9dac-d102-4151-ba34-61718db1cde4","Type":"ContainerDied","Data":"3e3ecbd2eaa2d32b583594b079d6c6f78c9de29f8fc12d6152470a0aa6eae0ff"} Jul 15 05:09:43.600780 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:43.600714 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" event={"ID":"f70e9dac-d102-4151-ba34-61718db1cde4","Type":"ContainerStarted","Data":"18ef5305a0aee4879eec9000ab9d5bd043df16f7fd7f4f3ef1bb49a1de202467"} Jul 15 05:09:44.608611 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.608537 2555 generic.go:356] "Generic (PLEG): container finished" podID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerID="a05b271dd1ae326401e6c77b1dbaf5769435f55b55c0c7afeb6155cd469694af" exitCode=0 Jul 15 05:09:44.608611 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.608588 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" event={"ID":"3859bc27-94bc-4db6-91c1-3d3d287458bf","Type":"ContainerDied","Data":"a05b271dd1ae326401e6c77b1dbaf5769435f55b55c0c7afeb6155cd469694af"} Jul 15 05:09:44.610782 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.610755 2555 generic.go:356] "Generic (PLEG): container finished" podID="953590f4-674f-4a7a-9db8-a73792f704e1" containerID="c94131c92582234787672b55cec1e5df3a5d55a596e3596f2788be93e7f6a438" exitCode=0 Jul 15 05:09:44.610920 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.610823 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" event={"ID":"953590f4-674f-4a7a-9db8-a73792f704e1","Type":"ContainerDied","Data":"c94131c92582234787672b55cec1e5df3a5d55a596e3596f2788be93e7f6a438"} Jul 15 05:09:44.612589 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.612567 2555 generic.go:356] "Generic (PLEG): container finished" podID="f70e9dac-d102-4151-ba34-61718db1cde4" containerID="7f9db2a76b10b17dc82a3b6ced1cf3fe4e7b34b36f852ec4f570b78687c15170" exitCode=0 Jul 15 05:09:44.612705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.612652 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" event={"ID":"f70e9dac-d102-4151-ba34-61718db1cde4","Type":"ContainerDied","Data":"7f9db2a76b10b17dc82a3b6ced1cf3fe4e7b34b36f852ec4f570b78687c15170"} Jul 15 05:09:44.751586 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.751560 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:44.878183 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.878089 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-bundle\") pod \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " Jul 15 05:09:44.878183 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.878164 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-util\") pod \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " Jul 15 05:09:44.878388 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.878230 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdqrd\" (UniqueName: \"kubernetes.io/projected/7c5209b8-2e23-4481-b651-a47a4fbe20d0-kube-api-access-vdqrd\") pod \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\" (UID: \"7c5209b8-2e23-4481-b651-a47a4fbe20d0\") " Jul 15 05:09:44.878842 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.878649 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-bundle" (OuterVolumeSpecName: "bundle") pod "7c5209b8-2e23-4481-b651-a47a4fbe20d0" (UID: "7c5209b8-2e23-4481-b651-a47a4fbe20d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:09:44.880982 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.880962 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c5209b8-2e23-4481-b651-a47a4fbe20d0-kube-api-access-vdqrd" (OuterVolumeSpecName: "kube-api-access-vdqrd") pod "7c5209b8-2e23-4481-b651-a47a4fbe20d0" (UID: "7c5209b8-2e23-4481-b651-a47a4fbe20d0"). InnerVolumeSpecName "kube-api-access-vdqrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:09:44.884468 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.884447 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-util" (OuterVolumeSpecName: "util") pod "7c5209b8-2e23-4481-b651-a47a4fbe20d0" (UID: "7c5209b8-2e23-4481-b651-a47a4fbe20d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:09:44.979692 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.979662 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-bundle\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:44.979692 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.979688 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7c5209b8-2e23-4481-b651-a47a4fbe20d0-util\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:44.979692 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:44.979701 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdqrd\" (UniqueName: \"kubernetes.io/projected/7c5209b8-2e23-4481-b651-a47a4fbe20d0-kube-api-access-vdqrd\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:45.620326 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.620244 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" Jul 15 05:09:45.620326 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.620271 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87" event={"ID":"7c5209b8-2e23-4481-b651-a47a4fbe20d0","Type":"ContainerDied","Data":"fa7ab6f44e7932d7d1a76e18dcfc000792e208583c3d681cdc366c3216db62b0"} Jul 15 05:09:45.620326 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.620318 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa7ab6f44e7932d7d1a76e18dcfc000792e208583c3d681cdc366c3216db62b0" Jul 15 05:09:45.622655 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.622621 2555 generic.go:356] "Generic (PLEG): container finished" podID="f70e9dac-d102-4151-ba34-61718db1cde4" containerID="56a185d487cbe0ef33a3ef6e31eea43491787ff33dc8cf3bef52095c45f2f59a" exitCode=0 Jul 15 05:09:45.622819 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.622698 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" event={"ID":"f70e9dac-d102-4151-ba34-61718db1cde4","Type":"ContainerDied","Data":"56a185d487cbe0ef33a3ef6e31eea43491787ff33dc8cf3bef52095c45f2f59a"} Jul 15 05:09:45.793968 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.793936 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:45.794580 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.794554 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:45.889190 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.889090 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnjwh\" (UniqueName: \"kubernetes.io/projected/3859bc27-94bc-4db6-91c1-3d3d287458bf-kube-api-access-nnjwh\") pod \"3859bc27-94bc-4db6-91c1-3d3d287458bf\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " Jul 15 05:09:45.889190 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.889134 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-util\") pod \"953590f4-674f-4a7a-9db8-a73792f704e1\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " Jul 15 05:09:45.889426 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.889211 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-bundle\") pod \"3859bc27-94bc-4db6-91c1-3d3d287458bf\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " Jul 15 05:09:45.889426 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.889235 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-bundle\") pod \"953590f4-674f-4a7a-9db8-a73792f704e1\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " Jul 15 05:09:45.889426 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.889258 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-util\") pod \"3859bc27-94bc-4db6-91c1-3d3d287458bf\" (UID: \"3859bc27-94bc-4db6-91c1-3d3d287458bf\") " Jul 15 05:09:45.889426 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.889286 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgpzt\" (UniqueName: \"kubernetes.io/projected/953590f4-674f-4a7a-9db8-a73792f704e1-kube-api-access-sgpzt\") pod \"953590f4-674f-4a7a-9db8-a73792f704e1\" (UID: \"953590f4-674f-4a7a-9db8-a73792f704e1\") " Jul 15 05:09:45.890258 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.890226 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-bundle" (OuterVolumeSpecName: "bundle") pod "953590f4-674f-4a7a-9db8-a73792f704e1" (UID: "953590f4-674f-4a7a-9db8-a73792f704e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:09:45.890258 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.890241 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-bundle" (OuterVolumeSpecName: "bundle") pod "3859bc27-94bc-4db6-91c1-3d3d287458bf" (UID: "3859bc27-94bc-4db6-91c1-3d3d287458bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:09:45.891486 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.891452 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3859bc27-94bc-4db6-91c1-3d3d287458bf-kube-api-access-nnjwh" (OuterVolumeSpecName: "kube-api-access-nnjwh") pod "3859bc27-94bc-4db6-91c1-3d3d287458bf" (UID: "3859bc27-94bc-4db6-91c1-3d3d287458bf"). InnerVolumeSpecName "kube-api-access-nnjwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:09:45.891693 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.891671 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953590f4-674f-4a7a-9db8-a73792f704e1-kube-api-access-sgpzt" (OuterVolumeSpecName: "kube-api-access-sgpzt") pod "953590f4-674f-4a7a-9db8-a73792f704e1" (UID: "953590f4-674f-4a7a-9db8-a73792f704e1"). InnerVolumeSpecName "kube-api-access-sgpzt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:09:45.895142 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.895120 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-util" (OuterVolumeSpecName: "util") pod "953590f4-674f-4a7a-9db8-a73792f704e1" (UID: "953590f4-674f-4a7a-9db8-a73792f704e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:09:45.898616 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.898589 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-util" (OuterVolumeSpecName: "util") pod "3859bc27-94bc-4db6-91c1-3d3d287458bf" (UID: "3859bc27-94bc-4db6-91c1-3d3d287458bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:09:45.990318 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.990272 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgpzt\" (UniqueName: \"kubernetes.io/projected/953590f4-674f-4a7a-9db8-a73792f704e1-kube-api-access-sgpzt\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:45.990318 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.990311 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnjwh\" (UniqueName: \"kubernetes.io/projected/3859bc27-94bc-4db6-91c1-3d3d287458bf-kube-api-access-nnjwh\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:45.990318 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.990322 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-util\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:45.990546 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.990333 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-bundle\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:45.990546 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.990341 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/953590f4-674f-4a7a-9db8-a73792f704e1-bundle\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:45.990546 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:45.990348 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3859bc27-94bc-4db6-91c1-3d3d287458bf-util\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:46.630056 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.630023 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" Jul 15 05:09:46.630471 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.630023 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl" event={"ID":"3859bc27-94bc-4db6-91c1-3d3d287458bf","Type":"ContainerDied","Data":"0ce82f8869fa7da7eb3adf71902319e96deecc621db7cd299e5aef654cd091ec"} Jul 15 05:09:46.630471 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.630178 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ce82f8869fa7da7eb3adf71902319e96deecc621db7cd299e5aef654cd091ec" Jul 15 05:09:46.631940 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.631914 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" Jul 15 05:09:46.631940 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.631930 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt" event={"ID":"953590f4-674f-4a7a-9db8-a73792f704e1","Type":"ContainerDied","Data":"4122ca78400efea20ee2732a01ad39313e6758644adc71a4995ff725d7b6aecd"} Jul 15 05:09:46.632079 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.631967 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4122ca78400efea20ee2732a01ad39313e6758644adc71a4995ff725d7b6aecd" Jul 15 05:09:46.784516 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.784483 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:46.897685 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.897586 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-bundle\") pod \"f70e9dac-d102-4151-ba34-61718db1cde4\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " Jul 15 05:09:46.897685 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.897635 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-util\") pod \"f70e9dac-d102-4151-ba34-61718db1cde4\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " Jul 15 05:09:46.897685 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.897657 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q79gl\" (UniqueName: \"kubernetes.io/projected/f70e9dac-d102-4151-ba34-61718db1cde4-kube-api-access-q79gl\") pod \"f70e9dac-d102-4151-ba34-61718db1cde4\" (UID: \"f70e9dac-d102-4151-ba34-61718db1cde4\") " Jul 15 05:09:46.898226 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.898200 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-bundle" (OuterVolumeSpecName: "bundle") pod "f70e9dac-d102-4151-ba34-61718db1cde4" (UID: "f70e9dac-d102-4151-ba34-61718db1cde4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:09:46.899861 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.899839 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f70e9dac-d102-4151-ba34-61718db1cde4-kube-api-access-q79gl" (OuterVolumeSpecName: "kube-api-access-q79gl") pod "f70e9dac-d102-4151-ba34-61718db1cde4" (UID: "f70e9dac-d102-4151-ba34-61718db1cde4"). InnerVolumeSpecName "kube-api-access-q79gl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:09:46.905671 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.905633 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-util" (OuterVolumeSpecName: "util") pod "f70e9dac-d102-4151-ba34-61718db1cde4" (UID: "f70e9dac-d102-4151-ba34-61718db1cde4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:09:46.999039 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.998995 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-util\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:46.999039 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.999027 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q79gl\" (UniqueName: \"kubernetes.io/projected/f70e9dac-d102-4151-ba34-61718db1cde4-kube-api-access-q79gl\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:46.999039 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:46.999038 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f70e9dac-d102-4151-ba34-61718db1cde4-bundle\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:09:47.639519 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:47.639490 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" Jul 15 05:09:47.640020 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:47.639534 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt" event={"ID":"f70e9dac-d102-4151-ba34-61718db1cde4","Type":"ContainerDied","Data":"18ef5305a0aee4879eec9000ab9d5bd043df16f7fd7f4f3ef1bb49a1de202467"} Jul 15 05:09:47.640020 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:09:47.639582 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18ef5305a0aee4879eec9000ab9d5bd043df16f7fd7f4f3ef1bb49a1de202467" Jul 15 05:11:05.930711 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.930673 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931044 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerName="extract" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931055 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerName="extract" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931069 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerName="util" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931075 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerName="util" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931082 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953590f4-674f-4a7a-9db8-a73792f704e1" containerName="pull" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931087 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="953590f4-674f-4a7a-9db8-a73792f704e1" containerName="pull" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931095 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerName="pull" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931100 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerName="pull" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931109 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70e9dac-d102-4151-ba34-61718db1cde4" containerName="util" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931115 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70e9dac-d102-4151-ba34-61718db1cde4" containerName="util" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931121 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70e9dac-d102-4151-ba34-61718db1cde4" containerName="pull" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931127 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70e9dac-d102-4151-ba34-61718db1cde4" containerName="pull" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931132 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f70e9dac-d102-4151-ba34-61718db1cde4" containerName="extract" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931137 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f70e9dac-d102-4151-ba34-61718db1cde4" containerName="extract" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931144 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953590f4-674f-4a7a-9db8-a73792f704e1" containerName="extract" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931149 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="953590f4-674f-4a7a-9db8-a73792f704e1" containerName="extract" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931157 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerName="util" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931162 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerName="util" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931170 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="953590f4-674f-4a7a-9db8-a73792f704e1" containerName="util" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931174 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="953590f4-674f-4a7a-9db8-a73792f704e1" containerName="util" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931180 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerName="extract" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931186 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerName="extract" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931193 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerName="pull" Jul 15 05:11:05.931202 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931199 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerName="pull" Jul 15 05:11:05.931901 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931253 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="953590f4-674f-4a7a-9db8-a73792f704e1" containerName="extract" Jul 15 05:11:05.931901 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931262 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3859bc27-94bc-4db6-91c1-3d3d287458bf" containerName="extract" Jul 15 05:11:05.931901 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931268 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f70e9dac-d102-4151-ba34-61718db1cde4" containerName="extract" Jul 15 05:11:05.931901 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.931276 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c5209b8-2e23-4481-b651-a47a4fbe20d0" containerName="extract" Jul 15 05:11:05.934480 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.934461 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:05.936540 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.936517 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 05:11:05.936634 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.936520 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 05:11:05.937229 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.937214 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-26c86\"" Jul 15 05:11:05.937284 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.937249 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 05:11:05.941965 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.941936 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:11:05.968307 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:05.968270 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:11:06.102554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:06.102516 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlrck\" (UniqueName: \"kubernetes.io/projected/f8167caa-1da1-4dd6-ba62-93a1ceb99bbd-kube-api-access-qlrck\") pod \"limitador-limitador-54d6d988d5-b9mww\" (UID: \"f8167caa-1da1-4dd6-ba62-93a1ceb99bbd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:06.102798 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:06.102675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8167caa-1da1-4dd6-ba62-93a1ceb99bbd-config-file\") pod \"limitador-limitador-54d6d988d5-b9mww\" (UID: \"f8167caa-1da1-4dd6-ba62-93a1ceb99bbd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:06.203844 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:06.203720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8167caa-1da1-4dd6-ba62-93a1ceb99bbd-config-file\") pod \"limitador-limitador-54d6d988d5-b9mww\" (UID: \"f8167caa-1da1-4dd6-ba62-93a1ceb99bbd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:06.203844 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:06.203809 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlrck\" (UniqueName: \"kubernetes.io/projected/f8167caa-1da1-4dd6-ba62-93a1ceb99bbd-kube-api-access-qlrck\") pod \"limitador-limitador-54d6d988d5-b9mww\" (UID: \"f8167caa-1da1-4dd6-ba62-93a1ceb99bbd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:06.204337 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:06.204316 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8167caa-1da1-4dd6-ba62-93a1ceb99bbd-config-file\") pod \"limitador-limitador-54d6d988d5-b9mww\" (UID: \"f8167caa-1da1-4dd6-ba62-93a1ceb99bbd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:06.211098 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:06.211074 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlrck\" (UniqueName: \"kubernetes.io/projected/f8167caa-1da1-4dd6-ba62-93a1ceb99bbd-kube-api-access-qlrck\") pod \"limitador-limitador-54d6d988d5-b9mww\" (UID: \"f8167caa-1da1-4dd6-ba62-93a1ceb99bbd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:06.246944 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:06.246900 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:06.382693 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:06.382664 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:11:06.384987 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:11:06.384957 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8167caa_1da1_4dd6_ba62_93a1ceb99bbd.slice/crio-25295304a5267cc92dec4d5be7bd39d5d6a9d7cca74ea09e7b3fc4bbd2702616 WatchSource:0}: Error finding container 25295304a5267cc92dec4d5be7bd39d5d6a9d7cca74ea09e7b3fc4bbd2702616: Status 404 returned error can't find the container with id 25295304a5267cc92dec4d5be7bd39d5d6a9d7cca74ea09e7b3fc4bbd2702616 Jul 15 05:11:07.051782 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:07.051743 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" event={"ID":"f8167caa-1da1-4dd6-ba62-93a1ceb99bbd","Type":"ContainerStarted","Data":"25295304a5267cc92dec4d5be7bd39d5d6a9d7cca74ea09e7b3fc4bbd2702616"} Jul 15 05:11:10.070923 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:10.070888 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" event={"ID":"f8167caa-1da1-4dd6-ba62-93a1ceb99bbd","Type":"ContainerStarted","Data":"a253819afb0b665bd65669469bab89e643b0fbbfde426ada9fccb5633d667d82"} Jul 15 05:11:10.071329 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:10.070964 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:11:10.088545 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:10.088493 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" podStartSLOduration=2.388169766 podStartE2EDuration="5.088473585s" totalImagesPullingTime="2.700303819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:11:10.08733413 +0000 UTC m=+754.820994281" watchObservedRunningTime="2026-07-15 05:11:10.088473585 +0000 UTC m=+754.822133747" Jul 15 05:11:21.077327 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:11:21.077294 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-b9mww" Jul 15 05:12:21.253034 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:12:21.252990 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:12:48.426769 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:12:48.426717 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:13:17.736228 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:17.736190 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:13:28.629701 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:28.629618 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:13:35.757775 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:35.757743 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:13:35.760396 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:35.760364 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:13:35.766769 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:35.765443 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:13:35.771503 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:35.771484 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:13:37.428748 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.428695 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8"] Jul 15 05:13:37.432235 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.432216 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.434997 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.434974 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zcd2w\"" Jul 15 05:13:37.435122 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.434975 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 05:13:37.435122 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.435031 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 05:13:37.435122 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.435046 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 05:13:37.440036 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.439882 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8"] Jul 15 05:13:37.556458 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.556413 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.556650 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.556477 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.556650 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.556514 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4brnd\" (UniqueName: \"kubernetes.io/projected/0e87ada3-ff3e-472a-9437-b12bf4c85817-kube-api-access-4brnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.556650 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.556552 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.556650 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.556605 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e87ada3-ff3e-472a-9437-b12bf4c85817-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.556841 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.556657 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657157 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657099 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657364 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657246 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657364 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657283 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657364 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657312 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4brnd\" (UniqueName: \"kubernetes.io/projected/0e87ada3-ff3e-472a-9437-b12bf4c85817-kube-api-access-4brnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657364 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657361 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657579 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657380 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e87ada3-ff3e-472a-9437-b12bf4c85817-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657673 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657647 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657756 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657693 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.657811 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.657781 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.659441 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.659417 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e87ada3-ff3e-472a-9437-b12bf4c85817-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.659784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.659761 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e87ada3-ff3e-472a-9437-b12bf4c85817-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.664174 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.664150 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4brnd\" (UniqueName: \"kubernetes.io/projected/0e87ada3-ff3e-472a-9437-b12bf4c85817-kube-api-access-4brnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8\" (UID: \"0e87ada3-ff3e-472a-9437-b12bf4c85817\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.743488 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.743401 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:37.895717 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:37.895693 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8"] Jul 15 05:13:37.897565 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:13:37.897538 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e87ada3_ff3e_472a_9437_b12bf4c85817.slice/crio-4319fbdf0d42d65d3175c3ada7d42a3dfe28a3dcd9d1d23da00f7495d60e11e2 WatchSource:0}: Error finding container 4319fbdf0d42d65d3175c3ada7d42a3dfe28a3dcd9d1d23da00f7495d60e11e2: Status 404 returned error can't find the container with id 4319fbdf0d42d65d3175c3ada7d42a3dfe28a3dcd9d1d23da00f7495d60e11e2 Jul 15 05:13:38.874651 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:38.874605 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" event={"ID":"0e87ada3-ff3e-472a-9437-b12bf4c85817","Type":"ContainerStarted","Data":"4319fbdf0d42d65d3175c3ada7d42a3dfe28a3dcd9d1d23da00f7495d60e11e2"} Jul 15 05:13:39.130770 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:39.130655 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:13:39.881529 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:39.881495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" event={"ID":"0e87ada3-ff3e-472a-9437-b12bf4c85817","Type":"ContainerStarted","Data":"82f16e437208e37faab43668196eed9e0e800b4b97cfddff9410a3f47dfc9b89"} Jul 15 05:13:39.900308 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:39.900251 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" podStartSLOduration=1.871472843 podStartE2EDuration="2.900230445s" totalImagesPullingTime="1.028757602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:13:39.899208085 +0000 UTC m=+904.632868235" watchObservedRunningTime="2026-07-15 05:13:39.900230445 +0000 UTC m=+904.633890596" Jul 15 05:13:47.744531 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:47.744496 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:47.745132 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:47.744563 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:47.757487 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:47.757457 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:13:47.932345 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:47.932311 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:13:47.933928 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:13:47.933907 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8" Jul 15 05:14:46.641645 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:14:46.641605 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:15:30.033402 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:15:30.033357 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:15:40.932801 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:15:40.932757 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:15:51.530620 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:15:51.530579 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:16:00.338675 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:16:00.338635 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:16:11.765106 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:16:11.765069 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:16:40.038167 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:16:40.038129 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:16:52.532019 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:16:52.531978 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:17:28.235913 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:17:28.235874 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:17:37.726579 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:17:37.726534 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:17:49.630264 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:17:49.630226 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:17:56.734295 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:17:56.734252 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:18:08.733709 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:18:08.733621 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:18:19.239496 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:18:19.239456 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:18:31.537276 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:18:31.537237 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:18:35.798961 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:18:35.798930 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:18:35.803753 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:18:35.803713 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:18:35.805634 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:18:35.805617 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:18:35.810331 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:18:35.810315 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:18:41.830765 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:18:41.830713 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:19:04.538010 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:19:04.537970 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:19:13.929810 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:19:13.929775 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:19:37.532645 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:19:37.532606 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:19:50.428513 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:19:50.428472 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:20:01.032764 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:20:01.032705 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:20:08.433214 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:20:08.433172 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:20:18.331083 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:20:18.331040 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:20:27.736676 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:20:27.736635 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:20:37.527901 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:20:37.527856 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:20:49.034719 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:20:49.034677 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:22:34.828414 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:22:34.828378 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:22:46.336213 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:22:46.336178 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:22:55.228490 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:22:55.228450 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:23:07.030213 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:07.030171 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:23:18.835541 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:18.835503 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:23:29.726076 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:29.726033 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:23:35.835010 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:35.834982 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:23:35.842649 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:35.842619 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:23:35.842914 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:35.842896 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:23:35.854558 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:35.854536 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:23:39.130958 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:39.130920 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:23:48.722911 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:48.722870 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:23:59.332356 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:23:59.332276 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:24:09.839470 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:24:09.839432 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:24:21.231646 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:24:21.231604 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:24:46.436780 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:24:46.436741 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:24:53.834136 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:24:53.834101 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:25:03.829467 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:25:03.829409 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:25:15.035505 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:25:15.035466 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:25:25.442508 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:25:25.442471 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:25:34.933022 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:25:34.932981 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:25:46.934822 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:25:46.934784 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:25:57.958469 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:25:57.958427 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:26:05.347537 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:26:05.347490 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:26:16.526269 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:26:16.526235 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:26:26.231816 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:26:26.231778 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:26:39.425071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:26:39.425029 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:26:48.140032 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:26:48.139994 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:26:57.835534 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:26:57.835445 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:27:07.925383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:27:07.925345 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:27:19.726232 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:27:19.726179 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:27:28.835887 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:27:28.835853 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:27:49.039068 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:27:49.039025 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:27:59.734465 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:27:59.734421 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:28:12.834455 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:12.834417 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:28:25.443789 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:25.443747 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:28:35.872241 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:35.872201 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:28:35.879302 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:35.879277 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:28:35.887132 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:35.887107 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:28:35.894115 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:35.894094 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:28:39.944282 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:39.944243 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:28:50.637951 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:50.637910 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:28:52.128319 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.128284 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t"] Jul 15 05:28:52.131675 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.131657 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" Jul 15 05:28:52.133823 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.133804 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:28:52.133951 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.133935 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:28:52.138246 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.138218 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t"] Jul 15 05:28:52.269715 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.269677 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f6ed8f1-c355-4d26-8258-240813f4b7c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t\" (UID: \"8f6ed8f1-c355-4d26-8258-240813f4b7c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" Jul 15 05:28:52.370361 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.370323 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f6ed8f1-c355-4d26-8258-240813f4b7c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t\" (UID: \"8f6ed8f1-c355-4d26-8258-240813f4b7c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" Jul 15 05:28:52.371043 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.371017 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f6ed8f1-c355-4d26-8258-240813f4b7c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t\" (UID: \"8f6ed8f1-c355-4d26-8258-240813f4b7c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" Jul 15 05:28:52.445435 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.445350 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" Jul 15 05:28:52.584511 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.584483 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t"] Jul 15 05:28:52.587127 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:28:52.587098 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6ed8f1_c355_4d26_8258_240813f4b7c8.slice/crio-fd96758d021f6f06ed5192c6bcb1b7a9346219469c3550e4758334e293806f15 WatchSource:0}: Error finding container fd96758d021f6f06ed5192c6bcb1b7a9346219469c3550e4758334e293806f15: Status 404 returned error can't find the container with id fd96758d021f6f06ed5192c6bcb1b7a9346219469c3550e4758334e293806f15 Jul 15 05:28:52.589130 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.589109 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 05:28:52.775676 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:28:52.775583 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" event={"ID":"8f6ed8f1-c355-4d26-8258-240813f4b7c8","Type":"ContainerStarted","Data":"fd96758d021f6f06ed5192c6bcb1b7a9346219469c3550e4758334e293806f15"} Jul 15 05:29:06.853527 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:06.853486 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" event={"ID":"8f6ed8f1-c355-4d26-8258-240813f4b7c8","Type":"ContainerStarted","Data":"7bd3ae71c914ca403a883882ad19dbd01ee0a5c5aefa03afa22fb8b965ce3022"} Jul 15 05:29:06.867502 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:06.867439 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" podStartSLOduration=1.044799033 podStartE2EDuration="14.867416657s" totalImagesPullingTime="13.822617624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:29:06.867282735 +0000 UTC m=+1831.600942878" watchObservedRunningTime="2026-07-15 05:29:06.867416657 +0000 UTC m=+1831.601076807" Jul 15 05:29:07.861049 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:07.861013 2555 generic.go:356] "Generic (PLEG): container finished" podID="8f6ed8f1-c355-4d26-8258-240813f4b7c8" containerID="7bd3ae71c914ca403a883882ad19dbd01ee0a5c5aefa03afa22fb8b965ce3022" exitCode=0 Jul 15 05:29:07.861462 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:07.861099 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" event={"ID":"8f6ed8f1-c355-4d26-8258-240813f4b7c8","Type":"ContainerDied","Data":"7bd3ae71c914ca403a883882ad19dbd01ee0a5c5aefa03afa22fb8b965ce3022"} Jul 15 05:29:09.001294 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:09.001266 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" Jul 15 05:29:09.018425 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:09.018381 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f6ed8f1-c355-4d26-8258-240813f4b7c8-maas-api-service-ca\") pod \"8f6ed8f1-c355-4d26-8258-240813f4b7c8\" (UID: \"8f6ed8f1-c355-4d26-8258-240813f4b7c8\") " Jul 15 05:29:09.020010 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:09.019970 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f6ed8f1-c355-4d26-8258-240813f4b7c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f6ed8f1-c355-4d26-8258-240813f4b7c8" (UID: "8f6ed8f1-c355-4d26-8258-240813f4b7c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:29:09.119719 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:09.119624 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f6ed8f1-c355-4d26-8258-240813f4b7c8-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:29:09.873183 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:09.873145 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" event={"ID":"8f6ed8f1-c355-4d26-8258-240813f4b7c8","Type":"ContainerDied","Data":"fd96758d021f6f06ed5192c6bcb1b7a9346219469c3550e4758334e293806f15"} Jul 15 05:29:09.873360 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:09.873204 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd96758d021f6f06ed5192c6bcb1b7a9346219469c3550e4758334e293806f15" Jul 15 05:29:09.873360 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:09.873157 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t" Jul 15 05:29:15.429676 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:15.429639 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:29:33.784011 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.783974 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq"] Jul 15 05:29:33.784384 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.784336 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f6ed8f1-c355-4d26-8258-240813f4b7c8" containerName="revoke-keys" Jul 15 05:29:33.784384 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.784347 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f6ed8f1-c355-4d26-8258-240813f4b7c8" containerName="revoke-keys" Jul 15 05:29:33.784453 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.784427 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f6ed8f1-c355-4d26-8258-240813f4b7c8" containerName="revoke-keys" Jul 15 05:29:33.792383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.792350 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" Jul 15 05:29:33.794482 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.794452 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:29:33.794623 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.794574 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:29:33.800205 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.800183 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq"] Jul 15 05:29:33.950199 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:33.950156 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe62c597-37f0-44d4-a4ca-38ed14f56ae8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq\" (UID: \"fe62c597-37f0-44d4-a4ca-38ed14f56ae8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" Jul 15 05:29:34.051342 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:34.051249 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe62c597-37f0-44d4-a4ca-38ed14f56ae8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq\" (UID: \"fe62c597-37f0-44d4-a4ca-38ed14f56ae8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" Jul 15 05:29:34.051956 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:34.051930 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe62c597-37f0-44d4-a4ca-38ed14f56ae8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq\" (UID: \"fe62c597-37f0-44d4-a4ca-38ed14f56ae8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" Jul 15 05:29:34.103604 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:34.103570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" Jul 15 05:29:34.251877 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:34.251854 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq"] Jul 15 05:29:35.015153 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:35.015114 2555 generic.go:356] "Generic (PLEG): container finished" podID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerID="cea3da3b04e3660959276b98bb69fe21b623896e23ca267a63a8129b6481edfe" exitCode=7 Jul 15 05:29:35.015516 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:35.015150 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" event={"ID":"fe62c597-37f0-44d4-a4ca-38ed14f56ae8","Type":"ContainerDied","Data":"cea3da3b04e3660959276b98bb69fe21b623896e23ca267a63a8129b6481edfe"} Jul 15 05:29:35.015516 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:35.015211 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" event={"ID":"fe62c597-37f0-44d4-a4ca-38ed14f56ae8","Type":"ContainerStarted","Data":"c1ff1126962dc0e79a437a98d1789c2c8692824262519fab254efa53cb6a95c7"} Jul 15 05:29:35.015516 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:35.015380 2555 scope.go:117] "RemoveContainer" containerID="cea3da3b04e3660959276b98bb69fe21b623896e23ca267a63a8129b6481edfe" Jul 15 05:29:36.022887 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:36.022845 2555 generic.go:356] "Generic (PLEG): container finished" podID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerID="0f177478c83f214ed621ae1dfbb31533c73edd7fdcb1bff12f9781437f62c767" exitCode=7 Jul 15 05:29:36.023317 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:36.022932 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" event={"ID":"fe62c597-37f0-44d4-a4ca-38ed14f56ae8","Type":"ContainerDied","Data":"0f177478c83f214ed621ae1dfbb31533c73edd7fdcb1bff12f9781437f62c767"} Jul 15 05:29:36.023317 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:36.023001 2555 scope.go:117] "RemoveContainer" containerID="cea3da3b04e3660959276b98bb69fe21b623896e23ca267a63a8129b6481edfe" Jul 15 05:29:36.023317 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:36.023200 2555 scope.go:117] "RemoveContainer" containerID="0f177478c83f214ed621ae1dfbb31533c73edd7fdcb1bff12f9781437f62c767" Jul 15 05:29:36.023462 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:29:36.023413 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq_odh-ai-gateway-infra(fe62c597-37f0-44d4-a4ca-38ed14f56ae8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" Jul 15 05:29:36.630351 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:36.630310 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:29:37.030599 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:37.030510 2555 scope.go:117] "RemoveContainer" containerID="0f177478c83f214ed621ae1dfbb31533c73edd7fdcb1bff12f9781437f62c767" Jul 15 05:29:37.031081 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:29:37.030795 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq_odh-ai-gateway-infra(fe62c597-37f0-44d4-a4ca-38ed14f56ae8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" Jul 15 05:29:48.790320 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:48.790282 2555 scope.go:117] "RemoveContainer" containerID="0f177478c83f214ed621ae1dfbb31533c73edd7fdcb1bff12f9781437f62c767" Jul 15 05:29:49.097131 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:49.097096 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" event={"ID":"fe62c597-37f0-44d4-a4ca-38ed14f56ae8","Type":"ContainerStarted","Data":"dca2060a4eea0800a0476f2cef86c64226d0e7371182c347fe9ac80193083f43"} Jul 15 05:29:49.111839 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:49.111788 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" podStartSLOduration=16.111772666 podStartE2EDuration="16.111772666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:29:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:29:49.110578229 +0000 UTC m=+1873.844238378" watchObservedRunningTime="2026-07-15 05:29:49.111772666 +0000 UTC m=+1873.845432814" Jul 15 05:29:50.104186 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:50.104156 2555 generic.go:356] "Generic (PLEG): container finished" podID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerID="dca2060a4eea0800a0476f2cef86c64226d0e7371182c347fe9ac80193083f43" exitCode=0 Jul 15 05:29:50.104582 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:50.104231 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" event={"ID":"fe62c597-37f0-44d4-a4ca-38ed14f56ae8","Type":"ContainerDied","Data":"dca2060a4eea0800a0476f2cef86c64226d0e7371182c347fe9ac80193083f43"} Jul 15 05:29:50.104582 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:50.104292 2555 scope.go:117] "RemoveContainer" containerID="0f177478c83f214ed621ae1dfbb31533c73edd7fdcb1bff12f9781437f62c767" Jul 15 05:29:50.121578 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:50.121545 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq"] Jul 15 05:29:51.247372 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:51.247342 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" Jul 15 05:29:51.306350 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:51.306312 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe62c597-37f0-44d4-a4ca-38ed14f56ae8-maas-api-service-ca\") pod \"fe62c597-37f0-44d4-a4ca-38ed14f56ae8\" (UID: \"fe62c597-37f0-44d4-a4ca-38ed14f56ae8\") " Jul 15 05:29:51.306714 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:51.306693 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe62c597-37f0-44d4-a4ca-38ed14f56ae8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe62c597-37f0-44d4-a4ca-38ed14f56ae8" (UID: "fe62c597-37f0-44d4-a4ca-38ed14f56ae8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:29:51.407172 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:51.407084 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe62c597-37f0-44d4-a4ca-38ed14f56ae8-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:29:52.117862 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:52.117818 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" event={"ID":"fe62c597-37f0-44d4-a4ca-38ed14f56ae8","Type":"ContainerDied","Data":"c1ff1126962dc0e79a437a98d1789c2c8692824262519fab254efa53cb6a95c7"} Jul 15 05:29:52.118054 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:52.117880 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1ff1126962dc0e79a437a98d1789c2c8692824262519fab254efa53cb6a95c7" Jul 15 05:29:52.118054 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:52.117839 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq" Jul 15 05:29:52.147068 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:52.147032 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq"] Jul 15 05:29:52.153067 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:52.153035 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-8z6tq"] Jul 15 05:29:53.795906 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:29:53.795871 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" path="/var/lib/kubelet/pods/fe62c597-37f0-44d4-a4ca-38ed14f56ae8/volumes" Jul 15 05:30:00.137436 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.137339 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9"] Jul 15 05:30:00.137951 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.137930 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.138024 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.137954 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.138024 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.137975 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.138024 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.137983 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.138024 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.137997 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.138024 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.138008 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.138267 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.138107 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.138267 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.138121 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.138267 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.138133 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe62c597-37f0-44d4-a4ca-38ed14f56ae8" containerName="revoke-keys" Jul 15 05:30:00.141145 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.141117 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" Jul 15 05:30:00.142126 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.142100 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7"] Jul 15 05:30:00.143410 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.143389 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:30:00.145230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.145208 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" Jul 15 05:30:00.149337 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.149307 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9"] Jul 15 05:30:00.153556 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.153537 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" Jul 15 05:30:00.162366 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.162313 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" Jul 15 05:30:00.164748 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.164706 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7"] Jul 15 05:30:00.517081 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.517001 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9"] Jul 15 05:30:00.519354 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:30:00.519309 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf368a42a_69cc_4387_be60_104780adeb5b.slice/crio-b9352e9411399e3fdbcbf7e5d5f72e75392f97a9cc97b8e08060920ea791a117 WatchSource:0}: Error finding container b9352e9411399e3fdbcbf7e5d5f72e75392f97a9cc97b8e08060920ea791a117: Status 404 returned error can't find the container with id b9352e9411399e3fdbcbf7e5d5f72e75392f97a9cc97b8e08060920ea791a117 Jul 15 05:30:00.547382 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:00.547342 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7"] Jul 15 05:30:00.549493 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:30:00.549457 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe57a8fb_bbb9_4722_a5e1_953cb5302382.slice/crio-bee340a027ecdef9b79a3b987079c161d2989ecfe4b4133b126c0b00005cc4ff WatchSource:0}: Error finding container bee340a027ecdef9b79a3b987079c161d2989ecfe4b4133b126c0b00005cc4ff: Status 404 returned error can't find the container with id bee340a027ecdef9b79a3b987079c161d2989ecfe4b4133b126c0b00005cc4ff Jul 15 05:30:01.172339 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:01.172300 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" event={"ID":"fe57a8fb-bbb9-4722-a5e1-953cb5302382","Type":"ContainerStarted","Data":"0e976455005aa7be72efd95351547f6a7684de5e5d72b29bdf8518e9853d99aa"} Jul 15 05:30:01.172820 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:01.172368 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" event={"ID":"fe57a8fb-bbb9-4722-a5e1-953cb5302382","Type":"ContainerStarted","Data":"bee340a027ecdef9b79a3b987079c161d2989ecfe4b4133b126c0b00005cc4ff"} Jul 15 05:30:01.174082 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:01.174053 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" event={"ID":"f368a42a-69cc-4387-be60-104780adeb5b","Type":"ContainerStarted","Data":"4c12695ede2f9ed57d033fd5cb8ca9fae80c468ebb9b3822c9885bc556babd44"} Jul 15 05:30:01.174191 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:01.174106 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" event={"ID":"f368a42a-69cc-4387-be60-104780adeb5b","Type":"ContainerStarted","Data":"b9352e9411399e3fdbcbf7e5d5f72e75392f97a9cc97b8e08060920ea791a117"} Jul 15 05:30:01.189124 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:01.189072 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" podStartSLOduration=1.189057446 podStartE2EDuration="1.189057446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:30:01.187427523 +0000 UTC m=+1885.921087672" watchObservedRunningTime="2026-07-15 05:30:01.189057446 +0000 UTC m=+1885.922717594" Jul 15 05:30:01.202744 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:01.202672 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" podStartSLOduration=1.202658889 podStartE2EDuration="1.202658889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:30:01.200195086 +0000 UTC m=+1885.933855234" watchObservedRunningTime="2026-07-15 05:30:01.202658889 +0000 UTC m=+1885.936319080" Jul 15 05:30:02.181442 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:02.181402 2555 generic.go:356] "Generic (PLEG): container finished" podID="f368a42a-69cc-4387-be60-104780adeb5b" containerID="4c12695ede2f9ed57d033fd5cb8ca9fae80c468ebb9b3822c9885bc556babd44" exitCode=0 Jul 15 05:30:02.181870 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:02.181486 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" event={"ID":"f368a42a-69cc-4387-be60-104780adeb5b","Type":"ContainerDied","Data":"4c12695ede2f9ed57d033fd5cb8ca9fae80c468ebb9b3822c9885bc556babd44"} Jul 15 05:30:02.183192 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:02.183168 2555 generic.go:356] "Generic (PLEG): container finished" podID="fe57a8fb-bbb9-4722-a5e1-953cb5302382" containerID="0e976455005aa7be72efd95351547f6a7684de5e5d72b29bdf8518e9853d99aa" exitCode=0 Jul 15 05:30:02.183316 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:02.183211 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" event={"ID":"fe57a8fb-bbb9-4722-a5e1-953cb5302382","Type":"ContainerDied","Data":"0e976455005aa7be72efd95351547f6a7684de5e5d72b29bdf8518e9853d99aa"} Jul 15 05:30:03.339457 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:03.339429 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" Jul 15 05:30:03.342560 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:03.342534 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" Jul 15 05:30:04.195259 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:04.195228 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" Jul 15 05:30:04.195447 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:04.195228 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29734890-7llg7" event={"ID":"fe57a8fb-bbb9-4722-a5e1-953cb5302382","Type":"ContainerDied","Data":"bee340a027ecdef9b79a3b987079c161d2989ecfe4b4133b126c0b00005cc4ff"} Jul 15 05:30:04.195447 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:04.195359 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bee340a027ecdef9b79a3b987079c161d2989ecfe4b4133b126c0b00005cc4ff" Jul 15 05:30:04.196692 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:04.196670 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" Jul 15 05:30:04.196851 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:04.196742 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9" event={"ID":"f368a42a-69cc-4387-be60-104780adeb5b","Type":"ContainerDied","Data":"b9352e9411399e3fdbcbf7e5d5f72e75392f97a9cc97b8e08060920ea791a117"} Jul 15 05:30:04.196851 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:04.196793 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9352e9411399e3fdbcbf7e5d5f72e75392f97a9cc97b8e08060920ea791a117" Jul 15 05:30:23.827536 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.827501 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp"] Jul 15 05:30:23.828041 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.827925 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe57a8fb-bbb9-4722-a5e1-953cb5302382" containerName="cleanup" Jul 15 05:30:23.828041 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.827938 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe57a8fb-bbb9-4722-a5e1-953cb5302382" containerName="cleanup" Jul 15 05:30:23.828041 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.827947 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f368a42a-69cc-4387-be60-104780adeb5b" containerName="cleanup" Jul 15 05:30:23.828041 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.827952 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="f368a42a-69cc-4387-be60-104780adeb5b" containerName="cleanup" Jul 15 05:30:23.828041 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.828009 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="f368a42a-69cc-4387-be60-104780adeb5b" containerName="cleanup" Jul 15 05:30:23.828041 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.828019 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe57a8fb-bbb9-4722-a5e1-953cb5302382" containerName="cleanup" Jul 15 05:30:23.831138 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.831118 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" Jul 15 05:30:23.833249 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.833229 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:30:23.833325 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.833280 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:30:23.838824 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.838794 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp"] Jul 15 05:30:23.893855 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.893813 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/366db62d-7fad-4efc-873c-894b0cefee7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp\" (UID: \"366db62d-7fad-4efc-873c-894b0cefee7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" Jul 15 05:30:23.995108 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.995067 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/366db62d-7fad-4efc-873c-894b0cefee7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp\" (UID: \"366db62d-7fad-4efc-873c-894b0cefee7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" Jul 15 05:30:23.995802 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:23.995782 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/366db62d-7fad-4efc-873c-894b0cefee7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp\" (UID: \"366db62d-7fad-4efc-873c-894b0cefee7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" Jul 15 05:30:24.143308 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:24.143263 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" Jul 15 05:30:24.281631 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:24.281604 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp"] Jul 15 05:30:24.283787 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:30:24.283759 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod366db62d_7fad_4efc_873c_894b0cefee7e.slice/crio-a60177fbf810c179fac7dacd0a96f341e91dc52ecee29fc987cc01c174a96492 WatchSource:0}: Error finding container a60177fbf810c179fac7dacd0a96f341e91dc52ecee29fc987cc01c174a96492: Status 404 returned error can't find the container with id a60177fbf810c179fac7dacd0a96f341e91dc52ecee29fc987cc01c174a96492 Jul 15 05:30:24.314012 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:24.313979 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" event={"ID":"366db62d-7fad-4efc-873c-894b0cefee7e","Type":"ContainerStarted","Data":"a60177fbf810c179fac7dacd0a96f341e91dc52ecee29fc987cc01c174a96492"} Jul 15 05:30:25.321966 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:25.321870 2555 generic.go:356] "Generic (PLEG): container finished" podID="366db62d-7fad-4efc-873c-894b0cefee7e" containerID="d47611e0de520fc90e479e9f17b725f610235b29e90da4a319366617ab8f226a" exitCode=0 Jul 15 05:30:25.322329 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:25.321961 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" event={"ID":"366db62d-7fad-4efc-873c-894b0cefee7e","Type":"ContainerDied","Data":"d47611e0de520fc90e479e9f17b725f610235b29e90da4a319366617ab8f226a"} Jul 15 05:30:26.476697 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:26.476662 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" Jul 15 05:30:26.616836 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:26.616800 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/366db62d-7fad-4efc-873c-894b0cefee7e-maas-api-service-ca\") pod \"366db62d-7fad-4efc-873c-894b0cefee7e\" (UID: \"366db62d-7fad-4efc-873c-894b0cefee7e\") " Jul 15 05:30:26.617220 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:26.617183 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/366db62d-7fad-4efc-873c-894b0cefee7e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "366db62d-7fad-4efc-873c-894b0cefee7e" (UID: "366db62d-7fad-4efc-873c-894b0cefee7e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:30:26.718054 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:26.718016 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/366db62d-7fad-4efc-873c-894b0cefee7e-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:30:27.333956 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:27.333921 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" event={"ID":"366db62d-7fad-4efc-873c-894b0cefee7e","Type":"ContainerDied","Data":"a60177fbf810c179fac7dacd0a96f341e91dc52ecee29fc987cc01c174a96492"} Jul 15 05:30:27.333956 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:27.333945 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp" Jul 15 05:30:27.334162 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:27.333973 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a60177fbf810c179fac7dacd0a96f341e91dc52ecee29fc987cc01c174a96492" Jul 15 05:30:34.292006 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:34.291973 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9"] Jul 15 05:30:34.294136 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:34.294113 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-ff1de9c2-29734890-9tbp9"] Jul 15 05:30:35.795664 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:35.795627 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f368a42a-69cc-4387-be60-104780adeb5b" path="/var/lib/kubelet/pods/f368a42a-69cc-4387-be60-104780adeb5b/volumes" Jul 15 05:30:36.722979 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:36.722937 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:30:46.315048 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.314988 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp"] Jul 15 05:30:46.315445 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.315385 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="366db62d-7fad-4efc-873c-894b0cefee7e" containerName="revoke-keys" Jul 15 05:30:46.315445 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.315397 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="366db62d-7fad-4efc-873c-894b0cefee7e" containerName="revoke-keys" Jul 15 05:30:46.315519 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.315462 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="366db62d-7fad-4efc-873c-894b0cefee7e" containerName="revoke-keys" Jul 15 05:30:46.318506 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.318489 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" Jul 15 05:30:46.320825 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.320801 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:30:46.321012 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.320993 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:30:46.324828 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.324807 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp"] Jul 15 05:30:46.388548 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.388509 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0031887e-f500-4b4b-bb42-d00a8d4bbb04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp\" (UID: \"0031887e-f500-4b4b-bb42-d00a8d4bbb04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" Jul 15 05:30:46.488994 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.488959 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0031887e-f500-4b4b-bb42-d00a8d4bbb04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp\" (UID: \"0031887e-f500-4b4b-bb42-d00a8d4bbb04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" Jul 15 05:30:46.489594 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.489573 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0031887e-f500-4b4b-bb42-d00a8d4bbb04-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp\" (UID: \"0031887e-f500-4b4b-bb42-d00a8d4bbb04\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" Jul 15 05:30:46.630665 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.630632 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" Jul 15 05:30:46.769069 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:46.769041 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp"] Jul 15 05:30:46.771067 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:30:46.771035 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0031887e_f500_4b4b_bb42_d00a8d4bbb04.slice/crio-11b8fb279644186560571bc47ae46ec3c0f003b164073564cd7cd644aa4f474d WatchSource:0}: Error finding container 11b8fb279644186560571bc47ae46ec3c0f003b164073564cd7cd644aa4f474d: Status 404 returned error can't find the container with id 11b8fb279644186560571bc47ae46ec3c0f003b164073564cd7cd644aa4f474d Jul 15 05:30:47.454978 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:47.454940 2555 generic.go:356] "Generic (PLEG): container finished" podID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerID="562c0042ea88ccc5c8f775e3a033a85d4fbc3e1b74a12225932e657668bedece" exitCode=7 Jul 15 05:30:47.455344 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:47.455016 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" event={"ID":"0031887e-f500-4b4b-bb42-d00a8d4bbb04","Type":"ContainerDied","Data":"562c0042ea88ccc5c8f775e3a033a85d4fbc3e1b74a12225932e657668bedece"} Jul 15 05:30:47.455344 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:47.455072 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" event={"ID":"0031887e-f500-4b4b-bb42-d00a8d4bbb04","Type":"ContainerStarted","Data":"11b8fb279644186560571bc47ae46ec3c0f003b164073564cd7cd644aa4f474d"} Jul 15 05:30:47.455344 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:47.455198 2555 scope.go:117] "RemoveContainer" containerID="562c0042ea88ccc5c8f775e3a033a85d4fbc3e1b74a12225932e657668bedece" Jul 15 05:30:48.462932 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:48.462892 2555 generic.go:356] "Generic (PLEG): container finished" podID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerID="cdb69c519a2a8eb8b65c84566d7fa404508142690ac8a5ce804f45024a5623ad" exitCode=7 Jul 15 05:30:48.463503 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:48.462978 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" event={"ID":"0031887e-f500-4b4b-bb42-d00a8d4bbb04","Type":"ContainerDied","Data":"cdb69c519a2a8eb8b65c84566d7fa404508142690ac8a5ce804f45024a5623ad"} Jul 15 05:30:48.463503 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:48.463065 2555 scope.go:117] "RemoveContainer" containerID="562c0042ea88ccc5c8f775e3a033a85d4fbc3e1b74a12225932e657668bedece" Jul 15 05:30:48.463503 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:48.463289 2555 scope.go:117] "RemoveContainer" containerID="cdb69c519a2a8eb8b65c84566d7fa404508142690ac8a5ce804f45024a5623ad" Jul 15 05:30:48.463828 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:30:48.463556 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp_odh-ai-gateway-infra(0031887e-f500-4b4b-bb42-d00a8d4bbb04)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" Jul 15 05:30:48.826463 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:48.826363 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:30:49.475340 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:30:49.475309 2555 scope.go:117] "RemoveContainer" containerID="cdb69c519a2a8eb8b65c84566d7fa404508142690ac8a5ce804f45024a5623ad" Jul 15 05:30:49.475867 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:30:49.475560 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp_odh-ai-gateway-infra(0031887e-f500-4b4b-bb42-d00a8d4bbb04)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" Jul 15 05:31:02.790097 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:02.790057 2555 scope.go:117] "RemoveContainer" containerID="cdb69c519a2a8eb8b65c84566d7fa404508142690ac8a5ce804f45024a5623ad" Jul 15 05:31:03.563169 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:03.563134 2555 generic.go:356] "Generic (PLEG): container finished" podID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerID="ef6ca7df639927adf0f9167245b3c274661ffd6b6ff76fe5df38e55da155da03" exitCode=0 Jul 15 05:31:03.563339 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:03.563197 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" event={"ID":"0031887e-f500-4b4b-bb42-d00a8d4bbb04","Type":"ContainerDied","Data":"ef6ca7df639927adf0f9167245b3c274661ffd6b6ff76fe5df38e55da155da03"} Jul 15 05:31:03.563339 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:03.563270 2555 scope.go:117] "RemoveContainer" containerID="cdb69c519a2a8eb8b65c84566d7fa404508142690ac8a5ce804f45024a5623ad" Jul 15 05:31:04.587242 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:04.587196 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp"] Jul 15 05:31:04.709669 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:04.709642 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" Jul 15 05:31:04.751258 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:04.751219 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0031887e-f500-4b4b-bb42-d00a8d4bbb04-maas-api-service-ca\") pod \"0031887e-f500-4b4b-bb42-d00a8d4bbb04\" (UID: \"0031887e-f500-4b4b-bb42-d00a8d4bbb04\") " Jul 15 05:31:04.751582 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:04.751557 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0031887e-f500-4b4b-bb42-d00a8d4bbb04-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0031887e-f500-4b4b-bb42-d00a8d4bbb04" (UID: "0031887e-f500-4b4b-bb42-d00a8d4bbb04"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:31:04.852919 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:04.852879 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0031887e-f500-4b4b-bb42-d00a8d4bbb04-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:31:05.576991 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:05.576960 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" Jul 15 05:31:05.577174 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:05.576968 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp" event={"ID":"0031887e-f500-4b4b-bb42-d00a8d4bbb04","Type":"ContainerDied","Data":"11b8fb279644186560571bc47ae46ec3c0f003b164073564cd7cd644aa4f474d"} Jul 15 05:31:05.577174 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:05.577085 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11b8fb279644186560571bc47ae46ec3c0f003b164073564cd7cd644aa4f474d" Jul 15 05:31:05.604337 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:05.604308 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp"] Jul 15 05:31:05.612113 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:05.612086 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-4dbfp"] Jul 15 05:31:05.795701 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:05.795656 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" path="/var/lib/kubelet/pods/0031887e-f500-4b4b-bb42-d00a8d4bbb04/volumes" Jul 15 05:31:36.364691 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.364651 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8"] Jul 15 05:31:36.365230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.365039 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:31:36.365230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.365052 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:31:36.365230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.365065 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:31:36.365230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.365071 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:31:36.365230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.365081 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:31:36.365230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.365087 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:31:36.365230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.365144 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:31:36.365230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.365153 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:31:36.368469 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.368451 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" Jul 15 05:31:36.370586 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.370562 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:31:36.370749 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.370596 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:31:36.375369 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.375342 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8"] Jul 15 05:31:36.440267 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.440224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a4da11-7289-4c62-a821-30630254ad32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8\" (UID: \"64a4da11-7289-4c62-a821-30630254ad32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" Jul 15 05:31:36.541369 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.541328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a4da11-7289-4c62-a821-30630254ad32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8\" (UID: \"64a4da11-7289-4c62-a821-30630254ad32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" Jul 15 05:31:36.542065 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.542043 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a4da11-7289-4c62-a821-30630254ad32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8\" (UID: \"64a4da11-7289-4c62-a821-30630254ad32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" Jul 15 05:31:36.681543 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.681452 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" Jul 15 05:31:36.850938 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:36.850903 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8"] Jul 15 05:31:36.852983 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:31:36.852951 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a4da11_7289_4c62_a821_30630254ad32.slice/crio-4b96f1ad97098e950bce576d2364ecda8add9b671c6335afb2c9d3d44387aeba WatchSource:0}: Error finding container 4b96f1ad97098e950bce576d2364ecda8add9b671c6335afb2c9d3d44387aeba: Status 404 returned error can't find the container with id 4b96f1ad97098e950bce576d2364ecda8add9b671c6335afb2c9d3d44387aeba Jul 15 05:31:37.772521 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:37.772484 2555 generic.go:356] "Generic (PLEG): container finished" podID="64a4da11-7289-4c62-a821-30630254ad32" containerID="795e6f214a82d4cc0dfe046a39f36f017b3a13f6bd312c5b8f0b458059f0d37c" exitCode=0 Jul 15 05:31:37.772943 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:37.772560 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" event={"ID":"64a4da11-7289-4c62-a821-30630254ad32","Type":"ContainerDied","Data":"795e6f214a82d4cc0dfe046a39f36f017b3a13f6bd312c5b8f0b458059f0d37c"} Jul 15 05:31:37.772943 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:37.772598 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" event={"ID":"64a4da11-7289-4c62-a821-30630254ad32","Type":"ContainerStarted","Data":"4b96f1ad97098e950bce576d2364ecda8add9b671c6335afb2c9d3d44387aeba"} Jul 15 05:31:38.920625 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:38.920599 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" Jul 15 05:31:38.969512 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:38.969478 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a4da11-7289-4c62-a821-30630254ad32-maas-api-service-ca\") pod \"64a4da11-7289-4c62-a821-30630254ad32\" (UID: \"64a4da11-7289-4c62-a821-30630254ad32\") " Jul 15 05:31:38.969868 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:38.969846 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a4da11-7289-4c62-a821-30630254ad32-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "64a4da11-7289-4c62-a821-30630254ad32" (UID: "64a4da11-7289-4c62-a821-30630254ad32"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:31:39.070873 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:39.070780 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a4da11-7289-4c62-a821-30630254ad32-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:31:39.785142 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:39.785117 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" Jul 15 05:31:39.785142 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:39.785127 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8" event={"ID":"64a4da11-7289-4c62-a821-30630254ad32","Type":"ContainerDied","Data":"4b96f1ad97098e950bce576d2364ecda8add9b671c6335afb2c9d3d44387aeba"} Jul 15 05:31:39.785371 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:39.785170 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b96f1ad97098e950bce576d2364ecda8add9b671c6335afb2c9d3d44387aeba" Jul 15 05:31:50.127066 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:31:50.127026 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:32:08.780520 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.780484 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc"] Jul 15 05:32:08.780954 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.780870 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a4da11-7289-4c62-a821-30630254ad32" containerName="revoke-keys" Jul 15 05:32:08.780954 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.780882 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a4da11-7289-4c62-a821-30630254ad32" containerName="revoke-keys" Jul 15 05:32:08.781034 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.780962 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a4da11-7289-4c62-a821-30630254ad32" containerName="revoke-keys" Jul 15 05:32:08.781034 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.780970 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0031887e-f500-4b4b-bb42-d00a8d4bbb04" containerName="revoke-keys" Jul 15 05:32:08.784436 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.784418 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" Jul 15 05:32:08.786690 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.786667 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:32:08.786841 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.786703 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:32:08.791121 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.791095 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc"] Jul 15 05:32:08.945383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:08.945336 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e17d0e-0125-40d3-9c19-f769032b8086-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc\" (UID: \"12e17d0e-0125-40d3-9c19-f769032b8086\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" Jul 15 05:32:09.046104 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:09.046004 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e17d0e-0125-40d3-9c19-f769032b8086-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc\" (UID: \"12e17d0e-0125-40d3-9c19-f769032b8086\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" Jul 15 05:32:09.046655 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:09.046631 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e17d0e-0125-40d3-9c19-f769032b8086-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc\" (UID: \"12e17d0e-0125-40d3-9c19-f769032b8086\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" Jul 15 05:32:09.096781 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:09.096707 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" Jul 15 05:32:09.242096 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:09.242063 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc"] Jul 15 05:32:09.243133 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:32:09.243106 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e17d0e_0125_40d3_9c19_f769032b8086.slice/crio-968044648e6fcfadd0d1b1344c3eb075bb69eaf2bc342e57843741f18ac82761 WatchSource:0}: Error finding container 968044648e6fcfadd0d1b1344c3eb075bb69eaf2bc342e57843741f18ac82761: Status 404 returned error can't find the container with id 968044648e6fcfadd0d1b1344c3eb075bb69eaf2bc342e57843741f18ac82761 Jul 15 05:32:09.961794 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:09.961745 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" event={"ID":"12e17d0e-0125-40d3-9c19-f769032b8086","Type":"ContainerStarted","Data":"bbae3485c01e3442b238bbc8e1f1d99262681658833e9203a351e48bfb8b9249"} Jul 15 05:32:09.962195 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:09.961825 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" event={"ID":"12e17d0e-0125-40d3-9c19-f769032b8086","Type":"ContainerStarted","Data":"968044648e6fcfadd0d1b1344c3eb075bb69eaf2bc342e57843741f18ac82761"} Jul 15 05:32:09.978546 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:09.978497 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" podStartSLOduration=1.978480128 podStartE2EDuration="1.978480128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:32:09.976293862 +0000 UTC m=+2014.709954024" watchObservedRunningTime="2026-07-15 05:32:09.978480128 +0000 UTC m=+2014.712140335" Jul 15 05:32:10.969978 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:10.969940 2555 generic.go:356] "Generic (PLEG): container finished" podID="12e17d0e-0125-40d3-9c19-f769032b8086" containerID="bbae3485c01e3442b238bbc8e1f1d99262681658833e9203a351e48bfb8b9249" exitCode=7 Jul 15 05:32:10.969978 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:10.969984 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" event={"ID":"12e17d0e-0125-40d3-9c19-f769032b8086","Type":"ContainerDied","Data":"bbae3485c01e3442b238bbc8e1f1d99262681658833e9203a351e48bfb8b9249"} Jul 15 05:32:10.970404 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:10.970192 2555 scope.go:117] "RemoveContainer" containerID="bbae3485c01e3442b238bbc8e1f1d99262681658833e9203a351e48bfb8b9249" Jul 15 05:32:11.925083 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:11.924989 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:32:11.978181 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:11.978148 2555 generic.go:356] "Generic (PLEG): container finished" podID="12e17d0e-0125-40d3-9c19-f769032b8086" containerID="63b2fb22d31ba0b2097169773d9f16eb1aa63bf386d9601903d044e2bc917aa9" exitCode=7 Jul 15 05:32:11.978601 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:11.978221 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" event={"ID":"12e17d0e-0125-40d3-9c19-f769032b8086","Type":"ContainerDied","Data":"63b2fb22d31ba0b2097169773d9f16eb1aa63bf386d9601903d044e2bc917aa9"} Jul 15 05:32:11.978601 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:11.978285 2555 scope.go:117] "RemoveContainer" containerID="bbae3485c01e3442b238bbc8e1f1d99262681658833e9203a351e48bfb8b9249" Jul 15 05:32:11.978601 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:11.978470 2555 scope.go:117] "RemoveContainer" containerID="63b2fb22d31ba0b2097169773d9f16eb1aa63bf386d9601903d044e2bc917aa9" Jul 15 05:32:11.978786 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:32:11.978660 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc_odh-ai-gateway-infra(12e17d0e-0125-40d3-9c19-f769032b8086)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" Jul 15 05:32:12.987161 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:12.987132 2555 scope.go:117] "RemoveContainer" containerID="63b2fb22d31ba0b2097169773d9f16eb1aa63bf386d9601903d044e2bc917aa9" Jul 15 05:32:12.987580 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:32:12.987364 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc_odh-ai-gateway-infra(12e17d0e-0125-40d3-9c19-f769032b8086)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" Jul 15 05:32:25.793000 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:25.792970 2555 scope.go:117] "RemoveContainer" containerID="63b2fb22d31ba0b2097169773d9f16eb1aa63bf386d9601903d044e2bc917aa9" Jul 15 05:32:27.076778 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:27.076721 2555 generic.go:356] "Generic (PLEG): container finished" podID="12e17d0e-0125-40d3-9c19-f769032b8086" containerID="db86f1855f39bdcdf61028bb76f0ed74a1cc5dfe35bc4e50519f28564dbb709d" exitCode=0 Jul 15 05:32:27.076778 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:27.076766 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" event={"ID":"12e17d0e-0125-40d3-9c19-f769032b8086","Type":"ContainerDied","Data":"db86f1855f39bdcdf61028bb76f0ed74a1cc5dfe35bc4e50519f28564dbb709d"} Jul 15 05:32:27.077286 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:27.076841 2555 scope.go:117] "RemoveContainer" containerID="63b2fb22d31ba0b2097169773d9f16eb1aa63bf386d9601903d044e2bc917aa9" Jul 15 05:32:28.101302 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:28.101264 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc"] Jul 15 05:32:28.223631 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:28.223603 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" Jul 15 05:32:28.312019 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:28.311978 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e17d0e-0125-40d3-9c19-f769032b8086-maas-api-service-ca\") pod \"12e17d0e-0125-40d3-9c19-f769032b8086\" (UID: \"12e17d0e-0125-40d3-9c19-f769032b8086\") " Jul 15 05:32:28.312385 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:28.312352 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12e17d0e-0125-40d3-9c19-f769032b8086-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "12e17d0e-0125-40d3-9c19-f769032b8086" (UID: "12e17d0e-0125-40d3-9c19-f769032b8086"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:32:28.413621 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:28.413527 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/12e17d0e-0125-40d3-9c19-f769032b8086-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:32:29.091096 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:29.091058 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" event={"ID":"12e17d0e-0125-40d3-9c19-f769032b8086","Type":"ContainerDied","Data":"968044648e6fcfadd0d1b1344c3eb075bb69eaf2bc342e57843741f18ac82761"} Jul 15 05:32:29.091096 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:29.091094 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc" Jul 15 05:32:29.091309 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:29.091112 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="968044648e6fcfadd0d1b1344c3eb075bb69eaf2bc342e57843741f18ac82761" Jul 15 05:32:29.118061 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:29.118027 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc"] Jul 15 05:32:29.124364 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:29.124338 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-k8lnc"] Jul 15 05:32:29.795932 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:32:29.795896 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" path="/var/lib/kubelet/pods/12e17d0e-0125-40d3-9c19-f769032b8086/volumes" Jul 15 05:33:08.819590 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.819500 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq"] Jul 15 05:33:08.820071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.819898 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:33:08.820071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.819912 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:33:08.820071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.819938 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:33:08.820071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.819945 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:33:08.820071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.820004 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:33:08.820071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.820015 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:33:08.820071 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.820022 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:33:08.823254 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.823233 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" Jul 15 05:33:08.825393 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.825367 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:33:08.826072 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.825478 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:33:08.829368 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.829344 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq"] Jul 15 05:33:08.882523 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.882482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8e64e4-c307-4cae-991a-0c028577884b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fde7053-79dfq\" (UID: \"5d8e64e4-c307-4cae-991a-0c028577884b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" Jul 15 05:33:08.983242 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.983211 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8e64e4-c307-4cae-991a-0c028577884b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fde7053-79dfq\" (UID: \"5d8e64e4-c307-4cae-991a-0c028577884b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" Jul 15 05:33:08.983903 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:08.983881 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8e64e4-c307-4cae-991a-0c028577884b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fde7053-79dfq\" (UID: \"5d8e64e4-c307-4cae-991a-0c028577884b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" Jul 15 05:33:09.135233 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:09.135188 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" Jul 15 05:33:09.275635 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:09.275609 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq"] Jul 15 05:33:09.277407 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:33:09.277379 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d8e64e4_c307_4cae_991a_0c028577884b.slice/crio-49e783ad93361651e628f15a70b63a55f907f7135ed2ccf60c89d6b7af128a10 WatchSource:0}: Error finding container 49e783ad93361651e628f15a70b63a55f907f7135ed2ccf60c89d6b7af128a10: Status 404 returned error can't find the container with id 49e783ad93361651e628f15a70b63a55f907f7135ed2ccf60c89d6b7af128a10 Jul 15 05:33:09.324179 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:09.324149 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" event={"ID":"5d8e64e4-c307-4cae-991a-0c028577884b","Type":"ContainerStarted","Data":"49e783ad93361651e628f15a70b63a55f907f7135ed2ccf60c89d6b7af128a10"} Jul 15 05:33:10.332147 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:10.332044 2555 generic.go:356] "Generic (PLEG): container finished" podID="5d8e64e4-c307-4cae-991a-0c028577884b" containerID="77e6ead356f6ea5d92640aedd4e121004c57a51bf979c7a61b66a43c0b308fc1" exitCode=0 Jul 15 05:33:10.332147 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:10.332129 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" event={"ID":"5d8e64e4-c307-4cae-991a-0c028577884b","Type":"ContainerDied","Data":"77e6ead356f6ea5d92640aedd4e121004c57a51bf979c7a61b66a43c0b308fc1"} Jul 15 05:33:11.474915 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:11.474888 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" Jul 15 05:33:11.500719 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:11.500690 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8e64e4-c307-4cae-991a-0c028577884b-maas-api-service-ca\") pod \"5d8e64e4-c307-4cae-991a-0c028577884b\" (UID: \"5d8e64e4-c307-4cae-991a-0c028577884b\") " Jul 15 05:33:11.501047 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:11.501026 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d8e64e4-c307-4cae-991a-0c028577884b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d8e64e4-c307-4cae-991a-0c028577884b" (UID: "5d8e64e4-c307-4cae-991a-0c028577884b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:33:11.601719 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:11.601645 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d8e64e4-c307-4cae-991a-0c028577884b-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:33:12.344019 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:12.343985 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" Jul 15 05:33:12.344174 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:12.344016 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fde7053-79dfq" event={"ID":"5d8e64e4-c307-4cae-991a-0c028577884b","Type":"ContainerDied","Data":"49e783ad93361651e628f15a70b63a55f907f7135ed2ccf60c89d6b7af128a10"} Jul 15 05:33:12.344174 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:12.344068 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49e783ad93361651e628f15a70b63a55f907f7135ed2ccf60c89d6b7af128a10" Jul 15 05:33:22.032356 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:22.032318 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:33:35.911824 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:35.911793 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:33:35.918926 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:35.918899 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:33:35.935131 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:35.935098 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:33:35.941608 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:33:35.941583 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:35:01.033664 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:01.033622 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:35:08.437681 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:08.437640 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:35:17.137026 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:17.136982 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:35:28.330963 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.330923 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:35:28.362491 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.362452 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq"] Jul 15 05:35:28.362861 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.362848 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:35:28.362911 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.362863 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e17d0e-0125-40d3-9c19-f769032b8086" containerName="revoke-keys" Jul 15 05:35:28.362911 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.362884 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d8e64e4-c307-4cae-991a-0c028577884b" containerName="revoke-keys" Jul 15 05:35:28.362911 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.362889 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d8e64e4-c307-4cae-991a-0c028577884b" containerName="revoke-keys" Jul 15 05:35:28.363012 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.362953 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d8e64e4-c307-4cae-991a-0c028577884b" containerName="revoke-keys" Jul 15 05:35:28.366039 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.366023 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" Jul 15 05:35:28.367991 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.367969 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:35:28.368097 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.368028 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:35:28.372660 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.372629 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq"] Jul 15 05:35:28.429970 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.429927 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq\" (UID: \"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" Jul 15 05:35:28.531241 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.531193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq\" (UID: \"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" Jul 15 05:35:28.531903 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.531882 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq\" (UID: \"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" Jul 15 05:35:28.678978 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.678939 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" Jul 15 05:35:28.819315 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:28.819247 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq"] Jul 15 05:35:28.822543 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:35:28.822509 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba00dfd7_18df_45e6_8bb6_bf12b4cf7e28.slice/crio-ddeec242300f7c823547a870c6cf5cb6751794e83b2b8c04728e27d8cc23ce57 WatchSource:0}: Error finding container ddeec242300f7c823547a870c6cf5cb6751794e83b2b8c04728e27d8cc23ce57: Status 404 returned error can't find the container with id ddeec242300f7c823547a870c6cf5cb6751794e83b2b8c04728e27d8cc23ce57 Jul 15 05:35:29.142858 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:29.142820 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" event={"ID":"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28","Type":"ContainerStarted","Data":"e01955b9e058e45850ceb6e3c51e6805d8c36d610d7a0d9b67ce693d752f362c"} Jul 15 05:35:29.143035 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:29.142875 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" event={"ID":"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28","Type":"ContainerStarted","Data":"ddeec242300f7c823547a870c6cf5cb6751794e83b2b8c04728e27d8cc23ce57"} Jul 15 05:35:29.164653 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:29.164588 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" podStartSLOduration=1.164571467 podStartE2EDuration="1.164571467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:35:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:35:29.163284533 +0000 UTC m=+2213.896944685" watchObservedRunningTime="2026-07-15 05:35:29.164571467 +0000 UTC m=+2213.898231615" Jul 15 05:35:30.150638 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:30.150600 2555 generic.go:356] "Generic (PLEG): container finished" podID="ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28" containerID="e01955b9e058e45850ceb6e3c51e6805d8c36d610d7a0d9b67ce693d752f362c" exitCode=0 Jul 15 05:35:30.151122 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:30.150682 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" event={"ID":"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28","Type":"ContainerDied","Data":"e01955b9e058e45850ceb6e3c51e6805d8c36d610d7a0d9b67ce693d752f362c"} Jul 15 05:35:31.295065 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:31.295038 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" Jul 15 05:35:31.458802 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:31.458699 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28-maas-api-service-ca\") pod \"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28\" (UID: \"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28\") " Jul 15 05:35:31.459026 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:31.459003 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28" (UID: "ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:35:31.560047 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:31.560010 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:35:32.164092 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:32.164056 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" event={"ID":"ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28","Type":"ContainerDied","Data":"ddeec242300f7c823547a870c6cf5cb6751794e83b2b8c04728e27d8cc23ce57"} Jul 15 05:35:32.164360 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:32.164109 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddeec242300f7c823547a870c6cf5cb6751794e83b2b8c04728e27d8cc23ce57" Jul 15 05:35:32.164360 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:32.164062 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq" Jul 15 05:35:41.524512 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:35:41.524471 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:36:23.642760 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:36:23.642670 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:36:34.834238 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:36:34.834192 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:36:35.957739 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:36:35.957704 2555 scope.go:117] "RemoveContainer" containerID="dca2060a4eea0800a0476f2cef86c64226d0e7371182c347fe9ac80193083f43" Jul 15 05:36:35.966869 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:36:35.966848 2555 scope.go:117] "RemoveContainer" containerID="4c12695ede2f9ed57d033fd5cb8ca9fae80c468ebb9b3822c9885bc556babd44" Jul 15 05:36:56.031518 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:36:56.031473 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:37:02.163451 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.163414 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb"] Jul 15 05:37:02.163852 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.163799 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28" containerName="revoke-keys" Jul 15 05:37:02.163852 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.163810 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28" containerName="revoke-keys" Jul 15 05:37:02.163928 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.163889 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28" containerName="revoke-keys" Jul 15 05:37:02.167112 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.167095 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" Jul 15 05:37:02.169349 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.169325 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:37:02.170070 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.170035 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:37:02.173543 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.173517 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb"] Jul 15 05:37:02.286954 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.286912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6b647f-329d-4979-9805-5e5332129c1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb\" (UID: \"8b6b647f-329d-4979-9805-5e5332129c1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" Jul 15 05:37:02.388193 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.388145 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6b647f-329d-4979-9805-5e5332129c1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb\" (UID: \"8b6b647f-329d-4979-9805-5e5332129c1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" Jul 15 05:37:02.388836 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.388814 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6b647f-329d-4979-9805-5e5332129c1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb\" (UID: \"8b6b647f-329d-4979-9805-5e5332129c1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" Jul 15 05:37:02.479278 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.479177 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" Jul 15 05:37:02.617772 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.617743 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb"] Jul 15 05:37:02.694145 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:02.694111 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" event={"ID":"8b6b647f-329d-4979-9805-5e5332129c1b","Type":"ContainerStarted","Data":"dc8487166b68dabf24a6c580001553385738963bc42ccf4e686bb16dbf2b9362"} Jul 15 05:37:03.701911 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:03.701820 2555 generic.go:356] "Generic (PLEG): container finished" podID="8b6b647f-329d-4979-9805-5e5332129c1b" containerID="2f3b2e22652e0c1cba338772524a8e7485b64226f2bbdcdfb9749c9f50b84455" exitCode=0 Jul 15 05:37:03.702263 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:03.701908 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" event={"ID":"8b6b647f-329d-4979-9805-5e5332129c1b","Type":"ContainerDied","Data":"2f3b2e22652e0c1cba338772524a8e7485b64226f2bbdcdfb9749c9f50b84455"} Jul 15 05:37:04.852739 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:04.852703 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" Jul 15 05:37:05.016967 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:05.016863 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6b647f-329d-4979-9805-5e5332129c1b-maas-api-service-ca\") pod \"8b6b647f-329d-4979-9805-5e5332129c1b\" (UID: \"8b6b647f-329d-4979-9805-5e5332129c1b\") " Jul 15 05:37:05.017237 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:05.017214 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6b647f-329d-4979-9805-5e5332129c1b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b6b647f-329d-4979-9805-5e5332129c1b" (UID: "8b6b647f-329d-4979-9805-5e5332129c1b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:37:05.117819 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:05.117779 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6b647f-329d-4979-9805-5e5332129c1b-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:37:05.715521 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:05.715490 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" Jul 15 05:37:05.715705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:05.715527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb" event={"ID":"8b6b647f-329d-4979-9805-5e5332129c1b","Type":"ContainerDied","Data":"dc8487166b68dabf24a6c580001553385738963bc42ccf4e686bb16dbf2b9362"} Jul 15 05:37:05.715705 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:05.715580 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc8487166b68dabf24a6c580001553385738963bc42ccf4e686bb16dbf2b9362" Jul 15 05:37:16.730479 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:16.730435 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:37:35.994302 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:37:35.994268 2555 scope.go:117] "RemoveContainer" containerID="ef6ca7df639927adf0f9167245b3c274661ffd6b6ff76fe5df38e55da155da03" Jul 15 05:38:23.639980 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:38:23.639939 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:38:35.953364 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:38:35.953335 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:38:35.960632 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:38:35.960608 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:38:35.983527 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:38:35.983497 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:38:35.990258 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:38:35.990233 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:38:36.016575 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:38:36.016540 2555 scope.go:117] "RemoveContainer" containerID="db86f1855f39bdcdf61028bb76f0ed74a1cc5dfe35bc4e50519f28564dbb709d" Jul 15 05:38:37.521366 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:38:37.521314 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:39:24.932523 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:39:24.932484 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:39:30.835411 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:39:30.835368 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:39:41.333201 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:39:41.333154 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:40:15.536371 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:15.536322 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:40:40.886907 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.886869 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:40:40.942497 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.942458 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9"] Jul 15 05:40:40.942876 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.942862 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6b647f-329d-4979-9805-5e5332129c1b" containerName="revoke-keys" Jul 15 05:40:40.942929 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.942877 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6b647f-329d-4979-9805-5e5332129c1b" containerName="revoke-keys" Jul 15 05:40:40.942966 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.942951 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6b647f-329d-4979-9805-5e5332129c1b" containerName="revoke-keys" Jul 15 05:40:40.946188 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.946160 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" Jul 15 05:40:40.948532 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.948489 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cadd75c-3be7-403c-b5b7-5657c006b0f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9\" (UID: \"6cadd75c-3be7-403c-b5b7-5657c006b0f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" Jul 15 05:40:40.948663 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.948573 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:40:40.949983 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.949959 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:40:40.965097 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:40.965065 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9"] Jul 15 05:40:41.049814 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:41.049768 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cadd75c-3be7-403c-b5b7-5657c006b0f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9\" (UID: \"6cadd75c-3be7-403c-b5b7-5657c006b0f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" Jul 15 05:40:41.050494 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:41.050472 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cadd75c-3be7-403c-b5b7-5657c006b0f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9\" (UID: \"6cadd75c-3be7-403c-b5b7-5657c006b0f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" Jul 15 05:40:41.256908 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:41.256818 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" Jul 15 05:40:41.404386 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:41.404367 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9"] Jul 15 05:40:41.406866 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:40:41.406829 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cadd75c_3be7_403c_b5b7_5657c006b0f8.slice/crio-87be2435e85c736bfe7fb8025cf9a5c16e6ff5dfe0fd109e07c95e545db2a467 WatchSource:0}: Error finding container 87be2435e85c736bfe7fb8025cf9a5c16e6ff5dfe0fd109e07c95e545db2a467: Status 404 returned error can't find the container with id 87be2435e85c736bfe7fb8025cf9a5c16e6ff5dfe0fd109e07c95e545db2a467 Jul 15 05:40:41.957758 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:41.957706 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" event={"ID":"6cadd75c-3be7-403c-b5b7-5657c006b0f8","Type":"ContainerStarted","Data":"c4599069d6c9b83ee0ccde3e085400c324c630628a59dc787da30d5a54f2a526"} Jul 15 05:40:41.958169 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:41.957777 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" event={"ID":"6cadd75c-3be7-403c-b5b7-5657c006b0f8","Type":"ContainerStarted","Data":"87be2435e85c736bfe7fb8025cf9a5c16e6ff5dfe0fd109e07c95e545db2a467"} Jul 15 05:40:41.972529 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:41.972476 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" podStartSLOduration=1.972459263 podStartE2EDuration="1.972459263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:40:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:40:41.970611088 +0000 UTC m=+2526.704271239" watchObservedRunningTime="2026-07-15 05:40:41.972459263 +0000 UTC m=+2526.706119412" Jul 15 05:40:42.965717 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:42.965678 2555 generic.go:356] "Generic (PLEG): container finished" podID="6cadd75c-3be7-403c-b5b7-5657c006b0f8" containerID="c4599069d6c9b83ee0ccde3e085400c324c630628a59dc787da30d5a54f2a526" exitCode=0 Jul 15 05:40:42.966120 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:42.965753 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" event={"ID":"6cadd75c-3be7-403c-b5b7-5657c006b0f8","Type":"ContainerDied","Data":"c4599069d6c9b83ee0ccde3e085400c324c630628a59dc787da30d5a54f2a526"} Jul 15 05:40:44.106090 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:44.106061 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" Jul 15 05:40:44.177175 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:44.177138 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cadd75c-3be7-403c-b5b7-5657c006b0f8-maas-api-service-ca\") pod \"6cadd75c-3be7-403c-b5b7-5657c006b0f8\" (UID: \"6cadd75c-3be7-403c-b5b7-5657c006b0f8\") " Jul 15 05:40:44.177542 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:44.177518 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cadd75c-3be7-403c-b5b7-5657c006b0f8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6cadd75c-3be7-403c-b5b7-5657c006b0f8" (UID: "6cadd75c-3be7-403c-b5b7-5657c006b0f8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:40:44.278284 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:44.278185 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cadd75c-3be7-403c-b5b7-5657c006b0f8-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:40:44.978179 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:44.978139 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" event={"ID":"6cadd75c-3be7-403c-b5b7-5657c006b0f8","Type":"ContainerDied","Data":"87be2435e85c736bfe7fb8025cf9a5c16e6ff5dfe0fd109e07c95e545db2a467"} Jul 15 05:40:44.978179 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:44.978178 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9" Jul 15 05:40:44.978401 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:44.978204 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87be2435e85c736bfe7fb8025cf9a5c16e6ff5dfe0fd109e07c95e545db2a467" Jul 15 05:40:53.623097 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:40:53.623055 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:41:07.070154 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.070105 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v"] Jul 15 05:41:07.070644 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.070502 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cadd75c-3be7-403c-b5b7-5657c006b0f8" containerName="revoke-keys" Jul 15 05:41:07.070644 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.070514 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cadd75c-3be7-403c-b5b7-5657c006b0f8" containerName="revoke-keys" Jul 15 05:41:07.070644 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.070592 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cadd75c-3be7-403c-b5b7-5657c006b0f8" containerName="revoke-keys" Jul 15 05:41:07.073916 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.073893 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" Jul 15 05:41:07.076510 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.076485 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:41:07.076795 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.076538 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2zt2\"" Jul 15 05:41:07.079442 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.079420 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v"] Jul 15 05:41:07.183273 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.183231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e3ff3e3-668c-4541-a4a7-bfad5099fbe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-de675f-n567v\" (UID: \"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" Jul 15 05:41:07.283966 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.283902 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e3ff3e3-668c-4541-a4a7-bfad5099fbe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-de675f-n567v\" (UID: \"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" Jul 15 05:41:07.284618 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.284588 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e3ff3e3-668c-4541-a4a7-bfad5099fbe5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-de675f-n567v\" (UID: \"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" Jul 15 05:41:07.386619 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.386579 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" Jul 15 05:41:07.524116 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:07.524091 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v"] Jul 15 05:41:07.526228 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:41:07.526198 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3ff3e3_668c_4541_a4a7_bfad5099fbe5.slice/crio-c02d916d7637ad90cc3575a19afd0129006b7a1839776857cf1035d6c61979b0 WatchSource:0}: Error finding container c02d916d7637ad90cc3575a19afd0129006b7a1839776857cf1035d6c61979b0: Status 404 returned error can't find the container with id c02d916d7637ad90cc3575a19afd0129006b7a1839776857cf1035d6c61979b0 Jul 15 05:41:08.112627 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:08.112588 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" event={"ID":"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5","Type":"ContainerStarted","Data":"b66ff8abec9b357daa94016cb39f6966b5b93509bffc3950182923b9502de966"} Jul 15 05:41:08.113058 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:08.112654 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" event={"ID":"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5","Type":"ContainerStarted","Data":"c02d916d7637ad90cc3575a19afd0129006b7a1839776857cf1035d6c61979b0"} Jul 15 05:41:08.128025 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:08.127964 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" podStartSLOduration=1.127948024 podStartE2EDuration="1.127948024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:41:08.125169396 +0000 UTC m=+2552.858829545" watchObservedRunningTime="2026-07-15 05:41:08.127948024 +0000 UTC m=+2552.861608232" Jul 15 05:41:09.126395 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:09.126352 2555 generic.go:356] "Generic (PLEG): container finished" podID="4e3ff3e3-668c-4541-a4a7-bfad5099fbe5" containerID="b66ff8abec9b357daa94016cb39f6966b5b93509bffc3950182923b9502de966" exitCode=0 Jul 15 05:41:09.126804 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:09.126433 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" event={"ID":"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5","Type":"ContainerDied","Data":"b66ff8abec9b357daa94016cb39f6966b5b93509bffc3950182923b9502de966"} Jul 15 05:41:10.269948 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:10.269918 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" Jul 15 05:41:10.415158 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:10.415061 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e3ff3e3-668c-4541-a4a7-bfad5099fbe5-maas-api-service-ca\") pod \"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5\" (UID: \"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5\") " Jul 15 05:41:10.415462 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:10.415436 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e3ff3e3-668c-4541-a4a7-bfad5099fbe5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e3ff3e3-668c-4541-a4a7-bfad5099fbe5" (UID: "4e3ff3e3-668c-4541-a4a7-bfad5099fbe5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:41:10.516152 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:10.516116 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e3ff3e3-668c-4541-a4a7-bfad5099fbe5-maas-api-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:41:11.139440 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:11.139409 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" Jul 15 05:41:11.139614 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:11.139439 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-de675f-n567v" event={"ID":"4e3ff3e3-668c-4541-a4a7-bfad5099fbe5","Type":"ContainerDied","Data":"c02d916d7637ad90cc3575a19afd0129006b7a1839776857cf1035d6c61979b0"} Jul 15 05:41:11.139614 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:11.139488 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c02d916d7637ad90cc3575a19afd0129006b7a1839776857cf1035d6c61979b0" Jul 15 05:41:20.730480 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:20.730433 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:41:41.637322 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:41.637285 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:41:44.875426 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.875383 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g"] Jul 15 05:41:44.875996 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.875978 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e3ff3e3-668c-4541-a4a7-bfad5099fbe5" containerName="revoke-keys" Jul 15 05:41:44.876057 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.876000 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e3ff3e3-668c-4541-a4a7-bfad5099fbe5" containerName="revoke-keys" Jul 15 05:41:44.876126 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.876115 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e3ff3e3-668c-4541-a4a7-bfad5099fbe5" containerName="revoke-keys" Jul 15 05:41:44.879795 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.879768 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:44.882286 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.882238 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 05:41:44.882493 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.882250 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:41:44.882627 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.882267 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-870c8a-serving-cert\"" Jul 15 05:41:44.882627 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.882373 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dbgk5\"" Jul 15 05:41:44.890040 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.890009 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g"] Jul 15 05:41:44.911688 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.911656 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98302c11-71b6-4ad9-84c0-3f134c68abca-openshift-service-ca\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:44.911903 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.911757 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf2q2\" (UniqueName: \"kubernetes.io/projected/98302c11-71b6-4ad9-84c0-3f134c68abca-kube-api-access-bf2q2\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:44.911903 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:44.911787 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98302c11-71b6-4ad9-84c0-3f134c68abca-maas-api-tls\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:45.012884 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.012840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98302c11-71b6-4ad9-84c0-3f134c68abca-openshift-service-ca\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:45.013097 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.012932 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf2q2\" (UniqueName: \"kubernetes.io/projected/98302c11-71b6-4ad9-84c0-3f134c68abca-kube-api-access-bf2q2\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:45.013097 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.012958 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98302c11-71b6-4ad9-84c0-3f134c68abca-maas-api-tls\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:45.013517 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.013495 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98302c11-71b6-4ad9-84c0-3f134c68abca-openshift-service-ca\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:45.015512 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.015484 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98302c11-71b6-4ad9-84c0-3f134c68abca-maas-api-tls\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:45.020697 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.020674 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf2q2\" (UniqueName: \"kubernetes.io/projected/98302c11-71b6-4ad9-84c0-3f134c68abca-kube-api-access-bf2q2\") pod \"maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:45.192618 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.192513 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:45.335998 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.335968 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g"] Jul 15 05:41:45.337766 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:41:45.337714 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98302c11_71b6_4ad9_84c0_3f134c68abca.slice/crio-5a63f0b06cfcef8dfd2bb52b774b008a79657288cef0b22b79fc180e2d621b26 WatchSource:0}: Error finding container 5a63f0b06cfcef8dfd2bb52b774b008a79657288cef0b22b79fc180e2d621b26: Status 404 returned error can't find the container with id 5a63f0b06cfcef8dfd2bb52b774b008a79657288cef0b22b79fc180e2d621b26 Jul 15 05:41:45.339167 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:45.339146 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 05:41:46.348610 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:46.348525 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" event={"ID":"98302c11-71b6-4ad9-84c0-3f134c68abca","Type":"ContainerStarted","Data":"5a63f0b06cfcef8dfd2bb52b774b008a79657288cef0b22b79fc180e2d621b26"} Jul 15 05:41:47.357039 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:47.357006 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" event={"ID":"98302c11-71b6-4ad9-84c0-3f134c68abca","Type":"ContainerStarted","Data":"8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73"} Jul 15 05:41:48.362541 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:48.362505 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:48.377984 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:48.377930 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" podStartSLOduration=2.428003055 podStartE2EDuration="4.377911528s" totalImagesPullingTime="1.949908473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:41:48.376362931 +0000 UTC m=+2593.110023081" watchObservedRunningTime="2026-07-15 05:41:48.377911528 +0000 UTC m=+2593.111571676" Jul 15 05:41:54.373435 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:54.373401 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:41:59.034861 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:41:59.034772 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:42:10.932010 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:10.931969 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:42:33.988178 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:33.988140 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g"] Jul 15 05:42:33.988785 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:33.988382 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" podUID="98302c11-71b6-4ad9-84c0-3f134c68abca" containerName="maas-api" containerID="cri-o://8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73" gracePeriod=30 Jul 15 05:42:34.244077 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.244008 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:42:34.255086 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.255060 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98302c11-71b6-4ad9-84c0-3f134c68abca-maas-api-tls\") pod \"98302c11-71b6-4ad9-84c0-3f134c68abca\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " Jul 15 05:42:34.255245 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.255106 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98302c11-71b6-4ad9-84c0-3f134c68abca-openshift-service-ca\") pod \"98302c11-71b6-4ad9-84c0-3f134c68abca\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " Jul 15 05:42:34.255245 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.255126 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf2q2\" (UniqueName: \"kubernetes.io/projected/98302c11-71b6-4ad9-84c0-3f134c68abca-kube-api-access-bf2q2\") pod \"98302c11-71b6-4ad9-84c0-3f134c68abca\" (UID: \"98302c11-71b6-4ad9-84c0-3f134c68abca\") " Jul 15 05:42:34.255440 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.255414 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98302c11-71b6-4ad9-84c0-3f134c68abca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "98302c11-71b6-4ad9-84c0-3f134c68abca" (UID: "98302c11-71b6-4ad9-84c0-3f134c68abca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:42:34.257414 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.257387 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98302c11-71b6-4ad9-84c0-3f134c68abca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "98302c11-71b6-4ad9-84c0-3f134c68abca" (UID: "98302c11-71b6-4ad9-84c0-3f134c68abca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 05:42:34.257521 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.257455 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98302c11-71b6-4ad9-84c0-3f134c68abca-kube-api-access-bf2q2" (OuterVolumeSpecName: "kube-api-access-bf2q2") pod "98302c11-71b6-4ad9-84c0-3f134c68abca" (UID: "98302c11-71b6-4ad9-84c0-3f134c68abca"). InnerVolumeSpecName "kube-api-access-bf2q2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:42:34.355743 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.355693 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/98302c11-71b6-4ad9-84c0-3f134c68abca-maas-api-tls\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:42:34.355948 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.355776 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/98302c11-71b6-4ad9-84c0-3f134c68abca-openshift-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:42:34.355948 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.355792 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf2q2\" (UniqueName: \"kubernetes.io/projected/98302c11-71b6-4ad9-84c0-3f134c68abca-kube-api-access-bf2q2\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:42:34.639382 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.639348 2555 generic.go:356] "Generic (PLEG): container finished" podID="98302c11-71b6-4ad9-84c0-3f134c68abca" containerID="8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73" exitCode=0 Jul 15 05:42:34.639554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.639392 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" Jul 15 05:42:34.639554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.639397 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" event={"ID":"98302c11-71b6-4ad9-84c0-3f134c68abca","Type":"ContainerDied","Data":"8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73"} Jul 15 05:42:34.639554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.639506 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g" event={"ID":"98302c11-71b6-4ad9-84c0-3f134c68abca","Type":"ContainerDied","Data":"5a63f0b06cfcef8dfd2bb52b774b008a79657288cef0b22b79fc180e2d621b26"} Jul 15 05:42:34.639554 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.639536 2555 scope.go:117] "RemoveContainer" containerID="8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73" Jul 15 05:42:34.650027 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.649999 2555 scope.go:117] "RemoveContainer" containerID="8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73" Jul 15 05:42:34.650363 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:42:34.650332 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73\": container with ID starting with 8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73 not found: ID does not exist" containerID="8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73" Jul 15 05:42:34.650457 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.650371 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73"} err="failed to get container status \"8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73\": rpc error: code = NotFound desc = could not find container \"8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73\": container with ID starting with 8d27c093e9d91842209c6132e898d4416500464e9b8b38889ad7c60165429a73 not found: ID does not exist" Jul 15 05:42:34.660562 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.660531 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g"] Jul 15 05:42:34.664466 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:34.664440 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-870c8a-9c54c6594-q9l4g"] Jul 15 05:42:35.796602 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:35.796567 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98302c11-71b6-4ad9-84c0-3f134c68abca" path="/var/lib/kubelet/pods/98302c11-71b6-4ad9-84c0-3f134c68abca/volumes" Jul 15 05:42:37.328869 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:37.328832 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:42:58.338274 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:42:58.338233 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:43:01.390515 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.390478 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w"] Jul 15 05:43:01.391097 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.391078 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98302c11-71b6-4ad9-84c0-3f134c68abca" containerName="maas-api" Jul 15 05:43:01.391150 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.391101 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="98302c11-71b6-4ad9-84c0-3f134c68abca" containerName="maas-api" Jul 15 05:43:01.391228 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.391217 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="98302c11-71b6-4ad9-84c0-3f134c68abca" containerName="maas-api" Jul 15 05:43:01.394964 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.394940 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:01.397212 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.397186 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1edf20-serving-cert\"" Jul 15 05:43:01.397348 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.397296 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dbgk5\"" Jul 15 05:43:01.398045 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.398028 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 05:43:01.398791 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.398770 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 05:43:01.404459 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.404437 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w"] Jul 15 05:43:01.471902 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.471859 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003cf99-2454-4fdc-834e-048fd5d0442f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:01.472099 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.471921 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm4hm\" (UniqueName: \"kubernetes.io/projected/4003cf99-2454-4fdc-834e-048fd5d0442f-kube-api-access-fm4hm\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:01.472099 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.472059 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:01.573142 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.573091 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4hm\" (UniqueName: \"kubernetes.io/projected/4003cf99-2454-4fdc-834e-048fd5d0442f-kube-api-access-fm4hm\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:01.573330 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.573194 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:01.573330 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.573217 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003cf99-2454-4fdc-834e-048fd5d0442f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:01.573421 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:43:01.573330 2555 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-serving-cert: secret "maas-api-e2e-shared-b-1edf20-serving-cert" not found Jul 15 05:43:01.573421 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:43:01.573407 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls podName:4003cf99-2454-4fdc-834e-048fd5d0442f nodeName:}" failed. No retries permitted until 2026-07-15 05:43:02.073390515 +0000 UTC m=+2666.807050642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls") pod "maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" (UID: "4003cf99-2454-4fdc-834e-048fd5d0442f") : secret "maas-api-e2e-shared-b-1edf20-serving-cert" not found Jul 15 05:43:01.573853 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.573836 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003cf99-2454-4fdc-834e-048fd5d0442f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:01.585021 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:01.584992 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm4hm\" (UniqueName: \"kubernetes.io/projected/4003cf99-2454-4fdc-834e-048fd5d0442f-kube-api-access-fm4hm\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:02.078512 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:02.078463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:02.081509 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:02.081479 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls\") pod \"maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:02.307944 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:02.307907 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:02.444802 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:02.444770 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w"] Jul 15 05:43:02.446713 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:43:02.446672 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4003cf99_2454_4fdc_834e_048fd5d0442f.slice/crio-4b959646bfcf376ee33329ea4d11684604a43b9714849e99acea69a16fcf98cf WatchSource:0}: Error finding container 4b959646bfcf376ee33329ea4d11684604a43b9714849e99acea69a16fcf98cf: Status 404 returned error can't find the container with id 4b959646bfcf376ee33329ea4d11684604a43b9714849e99acea69a16fcf98cf Jul 15 05:43:02.810392 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:02.810309 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" event={"ID":"4003cf99-2454-4fdc-834e-048fd5d0442f","Type":"ContainerStarted","Data":"4b959646bfcf376ee33329ea4d11684604a43b9714849e99acea69a16fcf98cf"} Jul 15 05:43:03.817307 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:03.817265 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" event={"ID":"4003cf99-2454-4fdc-834e-048fd5d0442f","Type":"ContainerStarted","Data":"6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1"} Jul 15 05:43:03.817805 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:03.817446 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:03.833014 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:03.832944 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" podStartSLOduration=2.451410744 podStartE2EDuration="2.832928482s" totalImagesPullingTime="381.517738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:43:03.831950715 +0000 UTC m=+2668.565610866" watchObservedRunningTime="2026-07-15 05:43:03.832928482 +0000 UTC m=+2668.566588631" Jul 15 05:43:09.829458 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:09.829426 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:43:14.332924 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:14.332882 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:43:23.727571 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:23.727533 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:43:36.001295 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:36.001265 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:43:36.008366 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:36.008338 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:43:36.023573 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:36.023550 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:43:36.030168 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:36.030142 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:43:46.533785 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:43:46.533746 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:44:20.023980 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:44:20.023941 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:44:37.130411 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:44:37.130372 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:44:52.431179 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:44:52.431134 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:45:10.227812 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:45:10.227712 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:45:27.424445 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:45:27.424404 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:45:44.635156 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:45:44.635115 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:46:01.928615 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:01.928578 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:46:18.734240 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.734205 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl"] Jul 15 05:46:18.737711 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.737692 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.739806 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.739782 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d43b4e\"/\"openshift-service-ca.crt\"" Jul 15 05:46:18.740476 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.740458 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d43b4e\"/\"sub-test-model-d43b4e-kserve-self-signed-certs\"" Jul 15 05:46:18.740476 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.740467 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d43b4e\"/\"kube-root-ca.crt\"" Jul 15 05:46:18.740622 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.740513 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d43b4e\"/\"default-dockercfg-h2rd9\"" Jul 15 05:46:18.745974 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.745952 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl"] Jul 15 05:46:18.830742 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.830704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-home\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.830920 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.830771 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-dshm\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.931806 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.931769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z98fj\" (UniqueName: \"kubernetes.io/projected/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-kube-api-access-z98fj\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.931976 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.931857 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tls-certs\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.931976 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.931916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-model-cache\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.931976 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.931960 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-home\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.932084 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.931988 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-dshm\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.932084 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.932023 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tmp-dir\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.932269 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.932255 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-home\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:18.934276 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:18.934244 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-dshm\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.032797 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.032683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z98fj\" (UniqueName: \"kubernetes.io/projected/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-kube-api-access-z98fj\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.032797 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.032782 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tls-certs\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.033002 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.032839 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-model-cache\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.033002 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.032895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tmp-dir\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.033260 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.033242 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tmp-dir\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.033299 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.033241 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-model-cache\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.035440 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.035411 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tls-certs\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.040017 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.039990 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z98fj\" (UniqueName: \"kubernetes.io/projected/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-kube-api-access-z98fj\") pod \"sub-test-model-d43b4e-kserve-5b497cf467-c85bl\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.048905 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.048879 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:19.189200 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.189168 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl"] Jul 15 05:46:19.190610 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:46:19.190587 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef887e66_05c1_4b4c_98d7_0781d9f2e4fb.slice/crio-32015a9c064017edad923d459991ca2e708fb3219c5d09084a4d4a38fbb49b3b WatchSource:0}: Error finding container 32015a9c064017edad923d459991ca2e708fb3219c5d09084a4d4a38fbb49b3b: Status 404 returned error can't find the container with id 32015a9c064017edad923d459991ca2e708fb3219c5d09084a4d4a38fbb49b3b Jul 15 05:46:19.972155 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.972111 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" event={"ID":"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb","Type":"ContainerStarted","Data":"6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc"} Jul 15 05:46:19.972155 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.972160 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" event={"ID":"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb","Type":"ContainerStarted","Data":"32015a9c064017edad923d459991ca2e708fb3219c5d09084a4d4a38fbb49b3b"} Jul 15 05:46:19.991013 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:19.990955 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" podStartSLOduration=1.990936455 podStartE2EDuration="1.990936455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 05:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:46:19.987564958 +0000 UTC m=+2864.721225106" watchObservedRunningTime="2026-07-15 05:46:19.990936455 +0000 UTC m=+2864.724596643" Jul 15 05:46:20.226708 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:20.226601 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:46:29.049762 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:29.049637 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:29.049762 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:29.049711 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:29.062439 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:29.062403 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:30.039798 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:30.039768 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:46:32.427336 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:32.427296 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:46:55.830870 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:46:55.830831 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:47:15.635178 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:15.635135 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:47:35.127991 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:35.127953 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:47:39.842833 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:39.842777 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl"] Jul 15 05:47:53.534342 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:53.534303 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:47:54.864308 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:54.864245 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" podUID="ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" containerName="main" containerID="cri-o://6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc" gracePeriod=45 Jul 15 05:47:55.120251 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.120185 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:47:55.212457 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212418 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-model-cache\") pod \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " Jul 15 05:47:55.212646 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212474 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tls-certs\") pod \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " Jul 15 05:47:55.212646 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212504 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-dshm\") pod \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " Jul 15 05:47:55.212646 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212523 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tmp-dir\") pod \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " Jul 15 05:47:55.212646 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212579 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-home\") pod \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " Jul 15 05:47:55.212646 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212595 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z98fj\" (UniqueName: \"kubernetes.io/projected/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-kube-api-access-z98fj\") pod \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\" (UID: \"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb\") " Jul 15 05:47:55.213007 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212774 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" (UID: "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:47:55.213007 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212852 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" (UID: "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:47:55.213007 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.212877 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-home" (OuterVolumeSpecName: "home") pod "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" (UID: "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:47:55.214888 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.214862 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-dshm" (OuterVolumeSpecName: "dshm") pod "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" (UID: "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 05:47:55.214988 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.214911 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-kube-api-access-z98fj" (OuterVolumeSpecName: "kube-api-access-z98fj") pod "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" (UID: "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb"). InnerVolumeSpecName "kube-api-access-z98fj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:47:55.214988 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.214943 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" (UID: "ef887e66-05c1-4b4c-98d7-0781d9f2e4fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 05:47:55.314147 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.314095 2555 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-dshm\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:47:55.314147 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.314137 2555 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tmp-dir\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:47:55.314147 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.314150 2555 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-home\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:47:55.314409 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.314161 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z98fj\" (UniqueName: \"kubernetes.io/projected/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-kube-api-access-z98fj\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:47:55.314409 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.314174 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-model-cache\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:47:55.314409 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.314185 2555 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb-tls-certs\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:47:55.554341 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.554254 2555 generic.go:356] "Generic (PLEG): container finished" podID="ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" containerID="6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc" exitCode=0 Jul 15 05:47:55.554341 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.554296 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" Jul 15 05:47:55.554341 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.554331 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" event={"ID":"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb","Type":"ContainerDied","Data":"6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc"} Jul 15 05:47:55.554566 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.554372 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl" event={"ID":"ef887e66-05c1-4b4c-98d7-0781d9f2e4fb","Type":"ContainerDied","Data":"32015a9c064017edad923d459991ca2e708fb3219c5d09084a4d4a38fbb49b3b"} Jul 15 05:47:55.554566 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.554390 2555 scope.go:117] "RemoveContainer" containerID="6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc" Jul 15 05:47:55.564265 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.564246 2555 scope.go:117] "RemoveContainer" containerID="6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc" Jul 15 05:47:55.564590 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:47:55.564571 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc\": container with ID starting with 6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc not found: ID does not exist" containerID="6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc" Jul 15 05:47:55.564652 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.564601 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc"} err="failed to get container status \"6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc\": rpc error: code = NotFound desc = could not find container \"6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc\": container with ID starting with 6be25fad1c503764bb1a13bd62459a7634775ecd5cb785431667df6ed4d143fc not found: ID does not exist" Jul 15 05:47:55.575331 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.575298 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl"] Jul 15 05:47:55.577929 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.577902 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d43b4e/sub-test-model-d43b4e-kserve-5b497cf467-c85bl"] Jul 15 05:47:55.795559 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:47:55.795529 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" path="/var/lib/kubelet/pods/ef887e66-05c1-4b4c-98d7-0781d9f2e4fb/volumes" Jul 15 05:48:07.133383 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:48:07.133294 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:48:36.040507 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:48:36.040477 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:48:36.047793 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:48:36.047766 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:48:36.071598 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:48:36.071568 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:48:36.078093 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:48:36.078068 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:48:49.234138 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:48:49.234097 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:49:09.933338 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:09.933300 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:49:29.425139 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:29.425043 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:49:37.542663 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.542619 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7590-139709926360368"] Jul 15 05:49:37.543090 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.543070 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" containerName="main" Jul 15 05:49:37.543090 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.543082 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" containerName="main" Jul 15 05:49:37.543173 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.543155 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef887e66-05c1-4b4c-98d7-0781d9f2e4fb" containerName="main" Jul 15 05:49:37.546422 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.546402 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7590-139709926360368" Jul 15 05:49:37.549168 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.549139 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-wjfck\"" Jul 15 05:49:37.552629 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.552558 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7590-139709926360368"] Jul 15 05:49:37.627674 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.627631 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5ds6\" (UniqueName: \"kubernetes.io/projected/6002691e-89a0-4422-b0ff-3f5c9c55cfbf-kube-api-access-d5ds6\") pod \"test-curl-7590-139709926360368\" (UID: \"6002691e-89a0-4422-b0ff-3f5c9c55cfbf\") " pod="openshift-ingress/test-curl-7590-139709926360368" Jul 15 05:49:37.728928 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.728885 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5ds6\" (UniqueName: \"kubernetes.io/projected/6002691e-89a0-4422-b0ff-3f5c9c55cfbf-kube-api-access-d5ds6\") pod \"test-curl-7590-139709926360368\" (UID: \"6002691e-89a0-4422-b0ff-3f5c9c55cfbf\") " pod="openshift-ingress/test-curl-7590-139709926360368" Jul 15 05:49:37.736785 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.736748 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5ds6\" (UniqueName: \"kubernetes.io/projected/6002691e-89a0-4422-b0ff-3f5c9c55cfbf-kube-api-access-d5ds6\") pod \"test-curl-7590-139709926360368\" (UID: \"6002691e-89a0-4422-b0ff-3f5c9c55cfbf\") " pod="openshift-ingress/test-curl-7590-139709926360368" Jul 15 05:49:37.857808 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:37.857771 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7590-139709926360368" Jul 15 05:49:38.002168 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:38.002141 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7590-139709926360368"] Jul 15 05:49:38.004075 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:49:38.004053 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6002691e_89a0_4422_b0ff_3f5c9c55cfbf.slice/crio-415a891ae9b80afc82e21655f6159bed75305259be396bd2f1c3a12972b6df53 WatchSource:0}: Error finding container 415a891ae9b80afc82e21655f6159bed75305259be396bd2f1c3a12972b6df53: Status 404 returned error can't find the container with id 415a891ae9b80afc82e21655f6159bed75305259be396bd2f1c3a12972b6df53 Jul 15 05:49:38.005452 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:38.005435 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 05:49:38.179593 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:38.179494 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7590-139709926360368" event={"ID":"6002691e-89a0-4422-b0ff-3f5c9c55cfbf","Type":"ContainerStarted","Data":"415a891ae9b80afc82e21655f6159bed75305259be396bd2f1c3a12972b6df53"} Jul 15 05:49:39.190131 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:39.190096 2555 generic.go:356] "Generic (PLEG): container finished" podID="6002691e-89a0-4422-b0ff-3f5c9c55cfbf" containerID="c944def361db3883135e953de91a4713eb1d24c0a8ea5129a38a701500934d8d" exitCode=0 Jul 15 05:49:39.190525 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:39.190184 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7590-139709926360368" event={"ID":"6002691e-89a0-4422-b0ff-3f5c9c55cfbf","Type":"ContainerDied","Data":"c944def361db3883135e953de91a4713eb1d24c0a8ea5129a38a701500934d8d"} Jul 15 05:49:40.341915 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:40.341888 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7590-139709926360368" Jul 15 05:49:40.374940 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:40.374910 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7590-139709926360368_6002691e-89a0-4422-b0ff-3f5c9c55cfbf/test-curl-7590-139709926360368/0.log" Jul 15 05:49:40.402043 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:40.401999 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7590-139709926360368"] Jul 15 05:49:40.405404 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:40.405377 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7590-139709926360368"] Jul 15 05:49:40.456342 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:40.456258 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5ds6\" (UniqueName: \"kubernetes.io/projected/6002691e-89a0-4422-b0ff-3f5c9c55cfbf-kube-api-access-d5ds6\") pod \"6002691e-89a0-4422-b0ff-3f5c9c55cfbf\" (UID: \"6002691e-89a0-4422-b0ff-3f5c9c55cfbf\") " Jul 15 05:49:40.458618 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:40.458585 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6002691e-89a0-4422-b0ff-3f5c9c55cfbf-kube-api-access-d5ds6" (OuterVolumeSpecName: "kube-api-access-d5ds6") pod "6002691e-89a0-4422-b0ff-3f5c9c55cfbf" (UID: "6002691e-89a0-4422-b0ff-3f5c9c55cfbf"). InnerVolumeSpecName "kube-api-access-d5ds6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:49:40.557131 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:40.557094 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5ds6\" (UniqueName: \"kubernetes.io/projected/6002691e-89a0-4422-b0ff-3f5c9c55cfbf-kube-api-access-d5ds6\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:49:41.203010 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:41.202977 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7590-139709926360368" Jul 15 05:49:41.203195 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:41.203024 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="415a891ae9b80afc82e21655f6159bed75305259be396bd2f1c3a12972b6df53" Jul 15 05:49:41.212299 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:49:41.212265 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7590-139709926360368\" is forbidden: User \"system:node:ip-10-0-134-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-241.ec2.internal' and this object" podUID="6002691e-89a0-4422-b0ff-3f5c9c55cfbf" pod="openshift-ingress/test-curl-7590-139709926360368" Jul 15 05:49:41.796347 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:41.796299 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6002691e-89a0-4422-b0ff-3f5c9c55cfbf" path="/var/lib/kubelet/pods/6002691e-89a0-4422-b0ff-3f5c9c55cfbf/volumes" Jul 15 05:49:43.226363 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:49:43.226324 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:50:08.324060 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:08.324021 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:50:30.862268 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:30.862229 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w"] Jul 15 05:50:30.862753 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:30.862501 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" podUID="4003cf99-2454-4fdc-834e-048fd5d0442f" containerName="maas-api" containerID="cri-o://6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1" gracePeriod=30 Jul 15 05:50:31.322504 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.322477 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:50:31.423935 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.423842 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003cf99-2454-4fdc-834e-048fd5d0442f-openshift-service-ca\") pod \"4003cf99-2454-4fdc-834e-048fd5d0442f\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " Jul 15 05:50:31.424091 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.423953 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm4hm\" (UniqueName: \"kubernetes.io/projected/4003cf99-2454-4fdc-834e-048fd5d0442f-kube-api-access-fm4hm\") pod \"4003cf99-2454-4fdc-834e-048fd5d0442f\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " Jul 15 05:50:31.424091 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.423983 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls\") pod \"4003cf99-2454-4fdc-834e-048fd5d0442f\" (UID: \"4003cf99-2454-4fdc-834e-048fd5d0442f\") " Jul 15 05:50:31.424300 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.424278 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4003cf99-2454-4fdc-834e-048fd5d0442f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4003cf99-2454-4fdc-834e-048fd5d0442f" (UID: "4003cf99-2454-4fdc-834e-048fd5d0442f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 05:50:31.426156 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.426120 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4003cf99-2454-4fdc-834e-048fd5d0442f-kube-api-access-fm4hm" (OuterVolumeSpecName: "kube-api-access-fm4hm") pod "4003cf99-2454-4fdc-834e-048fd5d0442f" (UID: "4003cf99-2454-4fdc-834e-048fd5d0442f"). InnerVolumeSpecName "kube-api-access-fm4hm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 05:50:31.426276 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.426158 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4003cf99-2454-4fdc-834e-048fd5d0442f" (UID: "4003cf99-2454-4fdc-834e-048fd5d0442f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 05:50:31.496230 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.496196 2555 generic.go:356] "Generic (PLEG): container finished" podID="4003cf99-2454-4fdc-834e-048fd5d0442f" containerID="6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1" exitCode=0 Jul 15 05:50:31.496404 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.496242 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" Jul 15 05:50:31.496404 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.496286 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" event={"ID":"4003cf99-2454-4fdc-834e-048fd5d0442f","Type":"ContainerDied","Data":"6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1"} Jul 15 05:50:31.496404 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.496346 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w" event={"ID":"4003cf99-2454-4fdc-834e-048fd5d0442f","Type":"ContainerDied","Data":"4b959646bfcf376ee33329ea4d11684604a43b9714849e99acea69a16fcf98cf"} Jul 15 05:50:31.496404 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.496374 2555 scope.go:117] "RemoveContainer" containerID="6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1" Jul 15 05:50:31.506402 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.506385 2555 scope.go:117] "RemoveContainer" containerID="6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1" Jul 15 05:50:31.506714 ip-10-0-134-241 kubenswrapper[2555]: E0715 05:50:31.506691 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1\": container with ID starting with 6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1 not found: ID does not exist" containerID="6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1" Jul 15 05:50:31.506875 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.506717 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1"} err="failed to get container status \"6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1\": rpc error: code = NotFound desc = could not find container \"6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1\": container with ID starting with 6905e6e6a75db57ae19943ac719673b186caadb6c144857b2766078adec5d4e1 not found: ID does not exist" Jul 15 05:50:31.517063 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.517011 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w"] Jul 15 05:50:31.519907 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.519874 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1edf20-5d9bffcb54-lfw4w"] Jul 15 05:50:31.525028 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.525005 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4003cf99-2454-4fdc-834e-048fd5d0442f-openshift-service-ca\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:50:31.525113 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.525030 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm4hm\" (UniqueName: \"kubernetes.io/projected/4003cf99-2454-4fdc-834e-048fd5d0442f-kube-api-access-fm4hm\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:50:31.525113 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.525041 2555 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4003cf99-2454-4fdc-834e-048fd5d0442f-maas-api-tls\") on node \"ip-10-0-134-241.ec2.internal\" DevicePath \"\"" Jul 15 05:50:31.795391 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:31.795310 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4003cf99-2454-4fdc-834e-048fd5d0442f" path="/var/lib/kubelet/pods/4003cf99-2454-4fdc-834e-048fd5d0442f/volumes" Jul 15 05:50:33.827879 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:33.827845 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-b9mww"] Jul 15 05:50:52.611215 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:52.611182 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749c75689b-cm76r_adcb73f7-8788-43a6-9241-84de48aa1764/copy-manifests/0.log" Jul 15 05:50:52.619156 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:52.619121 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749c75689b-cm76r_adcb73f7-8788-43a6-9241-84de48aa1764/manager/0.log" Jul 15 05:50:53.509308 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:53.509274 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29734890-7llg7_fe57a8fb-bbb9-4722-a5e1-953cb5302382/cleanup/0.log" Jul 15 05:50:53.738131 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:53.738107 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-90c99c81-b8r5t_8f6ed8f1-c355-4d26-8258-240813f4b7c8/revoke-keys/0.log" Jul 15 05:50:53.852434 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:53.852411 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-bd94e112-pcvr8_64a4da11-7289-4c62-a821-30630254ad32/revoke-keys/0.log" Jul 15 05:50:54.208615 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:54.208524 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-7fde7053-79dfq_5d8e64e4-c307-4cae-991a-0c028577884b/revoke-keys/0.log" Jul 15 05:50:54.321866 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:54.321836 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-891b7e-k7qd9_6cadd75c-3be7-403c-b5b7-5657c006b0f8/revoke-keys/0.log" Jul 15 05:50:54.435337 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:54.435307 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-de675f-n567v_4e3ff3e3-668c-4541-a4a7-bfad5099fbe5/revoke-keys/0.log" Jul 15 05:50:54.554216 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:54.554127 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-ff1de9c2-xtsdp_366db62d-7fad-4efc-873c-894b0cefee7e/revoke-keys/0.log" Jul 15 05:50:54.672892 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:54.672862 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-1fa2b35b-t8qxq_ba00dfd7-18df-45e6-8bb6-bf12b4cf7e28/revoke-keys/0.log" Jul 15 05:50:54.790343 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:54.790315 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-f84d43c4-dggbb_8b6b647f-329d-4979-9805-5e5332129c1b/revoke-keys/0.log" Jul 15 05:50:55.932515 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:55.932491 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87_7c5209b8-2e23-4481-b651-a47a4fbe20d0/util/0.log" Jul 15 05:50:55.939177 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:55.939154 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87_7c5209b8-2e23-4481-b651-a47a4fbe20d0/pull/0.log" Jul 15 05:50:55.945389 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:55.945370 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87_7c5209b8-2e23-4481-b651-a47a4fbe20d0/extract/0.log" Jul 15 05:50:56.059044 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.059011 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl_3859bc27-94bc-4db6-91c1-3d3d287458bf/util/0.log" Jul 15 05:50:56.065635 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.065593 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl_3859bc27-94bc-4db6-91c1-3d3d287458bf/pull/0.log" Jul 15 05:50:56.071685 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.071665 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl_3859bc27-94bc-4db6-91c1-3d3d287458bf/extract/0.log" Jul 15 05:50:56.182174 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.182140 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt_953590f4-674f-4a7a-9db8-a73792f704e1/util/0.log" Jul 15 05:50:56.189051 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.188969 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt_953590f4-674f-4a7a-9db8-a73792f704e1/pull/0.log" Jul 15 05:50:56.195738 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.195703 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt_953590f4-674f-4a7a-9db8-a73792f704e1/extract/0.log" Jul 15 05:50:56.305977 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.305944 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt_f70e9dac-d102-4151-ba34-61718db1cde4/util/0.log" Jul 15 05:50:56.312740 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.312693 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt_f70e9dac-d102-4151-ba34-61718db1cde4/pull/0.log" Jul 15 05:50:56.319035 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:56.319005 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt_f70e9dac-d102-4151-ba34-61718db1cde4/extract/0.log" Jul 15 05:50:57.173612 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:57.173528 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b9mww_f8167caa-1da1-4dd6-ba62-93a1ceb99bbd/limitador/0.log" Jul 15 05:50:57.805549 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:57.805513 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l22bh_cd7cee40-5215-465d-ad65-ae6144c99ac4/discovery/0.log" Jul 15 05:50:58.504113 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:58.504080 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcbcd97b-tsqv2_daaf9555-260f-47d0-8f19-144baa1c99c3/router/0.log" Jul 15 05:50:59.217018 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:50:59.216978 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbhg9f8_0e87ada3-ff3e-472a-9437-b12bf4c85817/main/0.log" Jul 15 05:51:06.907773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:06.907743 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-28pt6_fdf81bc9-ded5-40e1-a816-ad48da30874a/global-pull-secret-syncer/0.log" Jul 15 05:51:07.071783 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:07.071744 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-krghk_8cbb754d-f476-4b2e-bd0f-c613a7032b51/konnectivity-agent/0.log" Jul 15 05:51:07.177067 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:07.176976 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-241.ec2.internal_98260bfd566f14ae3c27b8cadea6e987/haproxy/0.log" Jul 15 05:51:10.672696 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.672629 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87_7c5209b8-2e23-4481-b651-a47a4fbe20d0/extract/0.log" Jul 15 05:51:10.698644 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.698613 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87_7c5209b8-2e23-4481-b651-a47a4fbe20d0/util/0.log" Jul 15 05:51:10.720188 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.720156 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jcb87_7c5209b8-2e23-4481-b651-a47a4fbe20d0/pull/0.log" Jul 15 05:51:10.748429 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.748387 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl_3859bc27-94bc-4db6-91c1-3d3d287458bf/extract/0.log" Jul 15 05:51:10.769122 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.769093 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl_3859bc27-94bc-4db6-91c1-3d3d287458bf/util/0.log" Jul 15 05:51:10.792340 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.792311 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cqqzl_3859bc27-94bc-4db6-91c1-3d3d287458bf/pull/0.log" Jul 15 05:51:10.818749 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.818700 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt_953590f4-674f-4a7a-9db8-a73792f704e1/extract/0.log" Jul 15 05:51:10.848773 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.848702 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt_953590f4-674f-4a7a-9db8-a73792f704e1/util/0.log" Jul 15 05:51:10.869691 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.869655 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734w8jt_953590f4-674f-4a7a-9db8-a73792f704e1/pull/0.log" Jul 15 05:51:10.903680 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.903641 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt_f70e9dac-d102-4151-ba34-61718db1cde4/extract/0.log" Jul 15 05:51:10.924653 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.924565 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt_f70e9dac-d102-4151-ba34-61718db1cde4/util/0.log" Jul 15 05:51:10.945464 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:10.945433 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ll2nt_f70e9dac-d102-4151-ba34-61718db1cde4/pull/0.log" Jul 15 05:51:11.591624 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:11.591595 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-b9mww_f8167caa-1da1-4dd6-ba62-93a1ceb99bbd/limitador/0.log" Jul 15 05:51:13.490981 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.490951 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_74b1bf88-b4fc-495c-94ae-8bce464172c0/alertmanager/0.log" Jul 15 05:51:13.513322 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.513295 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_74b1bf88-b4fc-495c-94ae-8bce464172c0/config-reloader/0.log" Jul 15 05:51:13.533644 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.533619 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_74b1bf88-b4fc-495c-94ae-8bce464172c0/kube-rbac-proxy-web/0.log" Jul 15 05:51:13.556911 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.556873 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_74b1bf88-b4fc-495c-94ae-8bce464172c0/kube-rbac-proxy/0.log" Jul 15 05:51:13.578106 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.578072 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_74b1bf88-b4fc-495c-94ae-8bce464172c0/kube-rbac-proxy-metric/0.log" Jul 15 05:51:13.601776 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.601741 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_74b1bf88-b4fc-495c-94ae-8bce464172c0/prom-label-proxy/0.log" Jul 15 05:51:13.621982 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.621956 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_74b1bf88-b4fc-495c-94ae-8bce464172c0/init-config-reloader/0.log" Jul 15 05:51:13.703123 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.703082 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wxjx7_7ccd6319-2339-4eae-983b-67e8a74cd67e/kube-state-metrics/0.log" Jul 15 05:51:13.720947 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.720922 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wxjx7_7ccd6319-2339-4eae-983b-67e8a74cd67e/kube-rbac-proxy-main/0.log" Jul 15 05:51:13.743127 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.743035 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-wxjx7_7ccd6319-2339-4eae-983b-67e8a74cd67e/kube-rbac-proxy-self/0.log" Jul 15 05:51:13.798884 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.798851 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-cwmlx_d1f6f7fe-f0bc-4624-bf38-ff57bd7138f3/monitoring-plugin/0.log" Jul 15 05:51:13.831870 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.831839 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8mpl6_87b6e940-b238-4c1b-be14-6d6b02f43f3d/node-exporter/0.log" Jul 15 05:51:13.850854 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.850820 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8mpl6_87b6e940-b238-4c1b-be14-6d6b02f43f3d/kube-rbac-proxy/0.log" Jul 15 05:51:13.872233 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:13.872209 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8mpl6_87b6e940-b238-4c1b-be14-6d6b02f43f3d/init-textfile/0.log" Jul 15 05:51:14.306174 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:14.306141 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-qbtrb_719e56a0-b008-4bd1-a210-0222c217a64b/prometheus-operator/0.log" Jul 15 05:51:14.322454 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:14.322425 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-qbtrb_719e56a0-b008-4bd1-a210-0222c217a64b/kube-rbac-proxy/0.log" Jul 15 05:51:14.344464 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:14.344434 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-t2vrq_86ee7b3f-b1c0-4f26-a5ed-00e9477f71dc/prometheus-operator-admission-webhook/0.log" Jul 15 05:51:14.378451 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:14.378415 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5df56d9fbd-rpbf2_66646fdc-695b-446a-abf2-256435ae0cb6/telemeter-client/0.log" Jul 15 05:51:14.398813 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:14.398782 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5df56d9fbd-rpbf2_66646fdc-695b-446a-abf2-256435ae0cb6/reload/0.log" Jul 15 05:51:14.421070 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:14.421029 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5df56d9fbd-rpbf2_66646fdc-695b-446a-abf2-256435ae0cb6/kube-rbac-proxy/0.log" Jul 15 05:51:16.059877 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:16.059846 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-wkdl8_8e4e433e-4e90-469b-9119-bbb2a87e368d/networking-console-plugin/0.log" Jul 15 05:51:16.662390 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:16.662357 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/1.log" Jul 15 05:51:16.670573 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:16.670544 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xvdnd_1884a849-4e3e-4e1e-919f-56eee0a8feb3/console-operator/2.log" Jul 15 05:51:17.266614 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.266583 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-xfqj8_d2fe0a81-8e69-4756-b8ab-94424f6a2644/download-server/0.log" Jul 15 05:51:17.821214 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.821159 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs"] Jul 15 05:51:17.821625 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.821608 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6002691e-89a0-4422-b0ff-3f5c9c55cfbf" containerName="test-curl-7590-139709926360368" Jul 15 05:51:17.821625 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.821626 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6002691e-89a0-4422-b0ff-3f5c9c55cfbf" containerName="test-curl-7590-139709926360368" Jul 15 05:51:17.821812 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.821643 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4003cf99-2454-4fdc-834e-048fd5d0442f" containerName="maas-api" Jul 15 05:51:17.821812 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.821649 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4003cf99-2454-4fdc-834e-048fd5d0442f" containerName="maas-api" Jul 15 05:51:17.821812 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.821711 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6002691e-89a0-4422-b0ff-3f5c9c55cfbf" containerName="test-curl-7590-139709926360368" Jul 15 05:51:17.821812 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.821718 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4003cf99-2454-4fdc-834e-048fd5d0442f" containerName="maas-api" Jul 15 05:51:17.824918 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.824901 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:17.826971 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.826944 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bw8rh\"/\"openshift-service-ca.crt\"" Jul 15 05:51:17.827096 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.826944 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bw8rh\"/\"default-dockercfg-b5756\"" Jul 15 05:51:17.827555 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.827536 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bw8rh\"/\"kube-root-ca.crt\"" Jul 15 05:51:17.832261 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.832235 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs"] Jul 15 05:51:17.934763 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.934693 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2c5r\" (UniqueName: \"kubernetes.io/projected/be18314c-df10-4380-8158-53e5ac8feffe-kube-api-access-n2c5r\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:17.934972 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.934782 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-sys\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:17.934972 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.934892 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-lib-modules\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:17.934972 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.934921 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-podres\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:17.935127 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:17.935006 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-proc\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.035784 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.035747 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-podres\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.035983 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.035806 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-proc\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.035983 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.035844 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2c5r\" (UniqueName: \"kubernetes.io/projected/be18314c-df10-4380-8158-53e5ac8feffe-kube-api-access-n2c5r\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.035983 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.035864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-sys\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.035983 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.035911 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-lib-modules\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.035983 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.035946 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-podres\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.035983 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.035946 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-proc\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.036285 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.035990 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-sys\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.036285 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.036036 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/be18314c-df10-4380-8158-53e5ac8feffe-lib-modules\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.042971 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.042943 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2c5r\" (UniqueName: \"kubernetes.io/projected/be18314c-df10-4380-8158-53e5ac8feffe-kube-api-access-n2c5r\") pod \"perf-node-gather-daemonset-sc8gs\" (UID: \"be18314c-df10-4380-8158-53e5ac8feffe\") " pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.046370 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.046341 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-7gzls_0d38ab4c-3d90-482e-bfca-b2c4ee1f5b61/volume-data-source-validator/0.log" Jul 15 05:51:18.137172 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.137136 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.277014 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.276984 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs"] Jul 15 05:51:18.278335 ip-10-0-134-241 kubenswrapper[2555]: W0715 05:51:18.278309 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbe18314c_df10_4380_8158_53e5ac8feffe.slice/crio-a356f167c113a0d5fdbc7073afc91c6a3f24d77425e6741fdc327d931e7a67ac WatchSource:0}: Error finding container a356f167c113a0d5fdbc7073afc91c6a3f24d77425e6741fdc327d931e7a67ac: Status 404 returned error can't find the container with id a356f167c113a0d5fdbc7073afc91c6a3f24d77425e6741fdc327d931e7a67ac Jul 15 05:51:18.775131 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.775092 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" event={"ID":"be18314c-df10-4380-8158-53e5ac8feffe","Type":"ContainerStarted","Data":"f0dabff9a3c4af296615f820e07a8aaa99329c8a58a8f636a444b7722a2e87a9"} Jul 15 05:51:18.775330 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.775156 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" event={"ID":"be18314c-df10-4380-8158-53e5ac8feffe","Type":"ContainerStarted","Data":"a356f167c113a0d5fdbc7073afc91c6a3f24d77425e6741fdc327d931e7a67ac"} Jul 15 05:51:18.775330 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.775186 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:18.790318 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:18.790263 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" podStartSLOduration=1.790245359 podStartE2EDuration="1.790245359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 05:51:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 05:51:18.788637357 +0000 UTC m=+3163.522297518" watchObservedRunningTime="2026-07-15 05:51:18.790245359 +0000 UTC m=+3163.523905508" Jul 15 05:51:19.192684 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:19.192653 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b9v4z_921e67df-7091-41fa-85ba-262de34c443c/dns/0.log" Jul 15 05:51:19.212885 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:19.212850 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b9v4z_921e67df-7091-41fa-85ba-262de34c443c/kube-rbac-proxy/0.log" Jul 15 05:51:19.330899 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:19.330869 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xxqhm_3ce77b74-fbf5-4ff1-b59f-e72e96651f95/dns-node-resolver/0.log" Jul 15 05:51:19.888402 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:19.888374 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fvlwf_7ab27930-ab90-4b71-b886-177912fc9147/node-ca/0.log" Jul 15 05:51:21.008877 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:21.008840 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l22bh_cd7cee40-5215-465d-ad65-ae6144c99ac4/discovery/0.log" Jul 15 05:51:21.192049 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:21.192014 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcbcd97b-tsqv2_daaf9555-260f-47d0-8f19-144baa1c99c3/router/0.log" Jul 15 05:51:21.883648 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:21.883605 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d8l9m_0af4d1b5-0ed7-4d63-ab89-40bb98cb8c02/serve-healthcheck-canary/0.log" Jul 15 05:51:22.459348 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:22.459296 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frbgm_4364a2ff-f67b-416d-a4b5-6fcccf00eabd/kube-rbac-proxy/0.log" Jul 15 05:51:22.479555 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:22.479521 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frbgm_4364a2ff-f67b-416d-a4b5-6fcccf00eabd/exporter/0.log" Jul 15 05:51:22.501232 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:22.501200 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-frbgm_4364a2ff-f67b-416d-a4b5-6fcccf00eabd/extractor/0.log" Jul 15 05:51:24.791362 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:24.791329 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bw8rh/perf-node-gather-daemonset-sc8gs" Jul 15 05:51:25.059794 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:25.059701 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749c75689b-cm76r_adcb73f7-8788-43a6-9241-84de48aa1764/manager/0.log" Jul 15 05:51:25.079998 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:25.079973 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-749c75689b-cm76r_adcb73f7-8788-43a6-9241-84de48aa1764/copy-manifests/0.log" Jul 15 05:51:26.361490 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:26.361456 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8fd856859-h6kcr_23d12890-f2bd-4110-b477-02b5c02e0598/manager/0.log" Jul 15 05:51:26.388768 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:26.388699 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wqbtb_d51e7cef-4e0e-4308-939b-01c019859500/openshift-lws-operator/0.log" Jul 15 05:51:27.792144 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:27.792065 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l22bh_cd7cee40-5215-465d-ad65-ae6144c99ac4/discovery/0.log" Jul 15 05:51:27.933659 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:27.933624 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcbcd97b-tsqv2_daaf9555-260f-47d0-8f19-144baa1c99c3/router/0.log" Jul 15 05:51:29.583599 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:29.583561 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-l22bh_cd7cee40-5215-465d-ad65-ae6144c99ac4/discovery/0.log" Jul 15 05:51:29.726033 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:29.725996 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6dcbcd97b-tsqv2_daaf9555-260f-47d0-8f19-144baa1c99c3/router/0.log" Jul 15 05:51:32.056749 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:32.056676 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-9w7hq_9d2edac7-0629-49c4-ab63-4e3ab3fa3a34/kube-storage-version-migrator-operator/1.log" Jul 15 05:51:32.058488 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:32.058461 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-9w7hq_9d2edac7-0629-49c4-ab63-4e3ab3fa3a34/kube-storage-version-migrator-operator/0.log" Jul 15 05:51:33.022749 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.022695 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65b8p_0d7128a3-fa59-4204-ab55-fb0748896cba/kube-multus/0.log" Jul 15 05:51:33.368015 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.367978 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pk4kz_fb3b9f40-853a-4bba-aee5-05f07618156a/kube-multus-additional-cni-plugins/0.log" Jul 15 05:51:33.388422 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.388395 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pk4kz_fb3b9f40-853a-4bba-aee5-05f07618156a/egress-router-binary-copy/0.log" Jul 15 05:51:33.408015 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.407986 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pk4kz_fb3b9f40-853a-4bba-aee5-05f07618156a/cni-plugins/0.log" Jul 15 05:51:33.427549 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.427519 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pk4kz_fb3b9f40-853a-4bba-aee5-05f07618156a/bond-cni-plugin/0.log" Jul 15 05:51:33.446862 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.446833 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pk4kz_fb3b9f40-853a-4bba-aee5-05f07618156a/routeoverride-cni/0.log" Jul 15 05:51:33.466834 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.466799 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pk4kz_fb3b9f40-853a-4bba-aee5-05f07618156a/whereabouts-cni-bincopy/0.log" Jul 15 05:51:33.487340 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.487301 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pk4kz_fb3b9f40-853a-4bba-aee5-05f07618156a/whereabouts-cni/0.log" Jul 15 05:51:33.583486 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.583450 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f45b8_8d8d7341-69a1-4be5-b75c-ad4079b82ca6/network-metrics-daemon/0.log" Jul 15 05:51:33.600976 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:33.600942 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f45b8_8d8d7341-69a1-4be5-b75c-ad4079b82ca6/kube-rbac-proxy/0.log" Jul 15 05:51:34.737753 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.737690 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-controller/0.log" Jul 15 05:51:34.753082 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.753049 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/1.log" Jul 15 05:51:34.753266 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.753083 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovn-acl-logging/0.log" Jul 15 05:51:34.777890 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.777855 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/kube-rbac-proxy-node/0.log" Jul 15 05:51:34.805642 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.805611 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/kube-rbac-proxy-ovn-metrics/0.log" Jul 15 05:51:34.821603 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.821560 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/northd/0.log" Jul 15 05:51:34.840542 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.840514 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/nbdb/0.log" Jul 15 05:51:34.859866 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.859835 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/sbdb/0.log" Jul 15 05:51:34.948181 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:34.948127 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ktznd_20fc919f-3fd8-4273-8254-a7843def7714/ovnkube-controller/0.log" Jul 15 05:51:36.266022 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:36.265988 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-nlnw8_173e78ca-cb4d-4710-a157-d3b0920ec374/check-endpoints/0.log" Jul 15 05:51:36.310440 ip-10-0-134-241 kubenswrapper[2555]: I0715 05:51:36.310405 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rskgr_7baa6030-ed2c-47aa-8eed-a59dfa2d1f33/network-check-target-container/0.log"