Jul 08 18:59:26.872001 ip-10-0-129-210 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 18:59:26.872012 ip-10-0-129-210 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 18:59:26.872019 ip-10-0-129-210 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 18:59:26.872267 ip-10-0-129-210 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 18:59:36.881787 ip-10-0-129-210 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 18:59:36.881803 ip-10-0-129-210 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 709ebd327ea34e029f8bd2e3f1615501 -- Jul 08 19:01:41.165721 ip-10-0-129-210 systemd[1]: Starting Kubernetes Kubelet... Jul 08 19:01:41.619520 ip-10-0-129-210 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:01:41.619520 ip-10-0-129-210 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 19:01:41.619520 ip-10-0-129-210 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:01:41.619520 ip-10-0-129-210 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 19:01:41.619520 ip-10-0-129-210 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 19:01:41.622164 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.622066 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 19:01:41.626896 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626874 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:41.626896 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626895 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626899 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626902 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626910 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626914 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626917 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626920 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626925 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626929 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626932 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626935 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626937 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626940 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626943 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626945 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626948 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626950 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626952 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626955 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:41.626966 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626957 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626960 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626962 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626965 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626967 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626971 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626976 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626980 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626983 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626986 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626988 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626991 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626993 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626996 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.626998 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627000 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627003 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627006 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627008 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627011 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:41.627441 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627013 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627651 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627659 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627665 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627670 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627673 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627676 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627679 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627682 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627685 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627687 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627690 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627692 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627694 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627697 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627700 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627702 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627704 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627707 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627709 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:41.627929 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627712 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627714 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627717 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627719 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627721 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627724 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627726 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627729 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627731 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627735 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627740 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627742 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627744 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627747 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627750 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627753 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627755 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627758 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627761 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627763 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:41.628429 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627768 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627770 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627773 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627775 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627778 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627780 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627783 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627786 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627789 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627791 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627794 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627796 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627799 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627801 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627804 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627807 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627810 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627812 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.627815 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628584 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:41.628911 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628592 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628595 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628598 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628601 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628604 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628607 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628610 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628612 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628614 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628617 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628619 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628624 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628627 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628631 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628635 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628638 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628641 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628644 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628647 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:41.629446 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628650 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628652 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628655 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628659 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628662 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628665 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628668 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628671 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628673 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628676 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628678 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628681 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628683 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628685 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628688 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628690 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628693 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628696 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628698 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:41.629918 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628701 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628704 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628706 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628709 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628711 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628714 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628716 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628719 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628723 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628725 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628728 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628731 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628733 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628736 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628738 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628740 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628743 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628745 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628748 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628750 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:41.630389 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628753 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628755 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628757 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628760 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628765 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628767 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628769 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628772 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628774 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628777 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628779 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628782 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628785 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628787 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628790 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628792 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628796 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628798 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628800 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628803 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:41.630880 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628806 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628808 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628811 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628813 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628816 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628818 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628820 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628823 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628825 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628828 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628830 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628833 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628835 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628838 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628842 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628844 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628848 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628851 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628853 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.628856 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:41.631366 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629252 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629256 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629259 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629263 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629266 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629270 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629272 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629275 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629278 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629280 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629283 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629285 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629288 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629291 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629294 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629297 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629299 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629303 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629306 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:41.631871 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629310 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629312 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629315 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629318 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629321 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629324 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629326 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629329 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629331 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629335 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629338 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629340 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629343 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629346 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629348 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629351 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629354 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629357 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629360 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629363 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:41.632331 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629365 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629367 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629370 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629374 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629377 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629397 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629400 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629402 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629405 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629408 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629410 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629413 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629415 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629418 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629421 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629423 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629426 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629428 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629431 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629433 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:41.632864 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629435 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629438 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629441 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629443 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629446 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629449 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629451 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629454 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629456 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629459 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629462 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629465 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629467 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629470 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629472 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629475 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629477 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629480 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629483 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629485 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:41.633342 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629488 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629490 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629492 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629494 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629497 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629499 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629502 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629504 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629506 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629510 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629512 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629515 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629517 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629520 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629522 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629525 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629528 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629530 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629533 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.629535 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:41.633884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629620 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629631 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629640 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629648 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629653 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629656 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629661 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629665 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629668 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629671 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629675 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629679 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629682 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629685 2560 flags.go:64] FLAG: --cgroup-root="" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629688 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629691 2560 flags.go:64] FLAG: --client-ca-file="" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629694 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629697 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629702 2560 flags.go:64] FLAG: --cluster-domain="" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629705 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629708 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629711 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629715 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629718 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 19:01:41.634363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629721 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629725 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629728 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629731 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629734 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629737 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629741 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629744 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629748 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629751 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629754 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629757 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629760 2560 flags.go:64] FLAG: --enable-server="true" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629763 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629768 2560 flags.go:64] FLAG: --event-burst="100" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629771 2560 flags.go:64] FLAG: --event-qps="50" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629773 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629776 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629779 2560 flags.go:64] FLAG: --eviction-hard="" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629783 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629786 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629789 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629792 2560 flags.go:64] FLAG: --eviction-soft="" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629794 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629797 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 19:01:41.634956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629800 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629803 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629806 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629809 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629812 2560 flags.go:64] FLAG: --feature-gates="" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629816 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629819 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629822 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629827 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629831 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629834 2560 flags.go:64] FLAG: --help="false" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629837 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-129-210.ec2.internal" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629839 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629843 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629846 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629849 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629853 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629855 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629858 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629861 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629864 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629867 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629870 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629872 2560 flags.go:64] FLAG: --kube-reserved="" Jul 08 19:01:41.635639 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629875 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629878 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629881 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629883 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629886 2560 flags.go:64] FLAG: --lock-file="" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629889 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629892 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629894 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629900 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629902 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629906 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629908 2560 flags.go:64] FLAG: --logging-format="text" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629911 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629915 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629917 2560 flags.go:64] FLAG: --manifest-url="" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629920 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629926 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629929 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629933 2560 flags.go:64] FLAG: --max-pods="110" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629936 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629939 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629942 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629945 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629948 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629951 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 19:01:41.636236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629954 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629962 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629965 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629968 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629975 2560 flags.go:64] FLAG: --pod-cidr="" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629978 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629984 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629987 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629991 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629994 2560 flags.go:64] FLAG: --port="10250" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.629997 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630000 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0271b4e111934882f" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630003 2560 flags.go:64] FLAG: --qos-reserved="" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630006 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630009 2560 flags.go:64] FLAG: --register-node="true" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630012 2560 flags.go:64] FLAG: --register-with-taints="" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630015 2560 flags.go:64] FLAG: --registry-burst="10" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630018 2560 flags.go:64] FLAG: --registry-qps="5" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630021 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630024 2560 flags.go:64] FLAG: --reserved-memory="" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630027 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630030 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630033 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630037 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630040 2560 flags.go:64] FLAG: --runonce="false" Jul 08 19:01:41.636871 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630043 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630046 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630049 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630053 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630055 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630058 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630061 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630064 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630067 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630070 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630073 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630076 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630079 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630083 2560 flags.go:64] FLAG: --system-cgroups="" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630085 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630090 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630093 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630096 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630101 2560 flags.go:64] FLAG: --tls-min-version="" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630103 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630106 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630109 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630111 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630114 2560 flags.go:64] FLAG: --v="2" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630118 2560 flags.go:64] FLAG: --version="false" Jul 08 19:01:41.637500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630122 2560 flags.go:64] FLAG: --vmodule="" Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630126 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.630129 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630246 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630249 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630254 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630257 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630259 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630262 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630264 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630270 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630272 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630275 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630277 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630280 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630282 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630285 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630288 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630290 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630293 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:41.638196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630295 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630298 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630301 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630303 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630306 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630310 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630314 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630317 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630320 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630323 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630326 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630329 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630332 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630334 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630337 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630339 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630342 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630346 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630348 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:41.639002 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630350 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630353 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630355 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630360 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630363 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630365 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630368 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630370 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630373 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630376 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630392 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630395 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630398 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630401 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630404 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630407 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630409 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630412 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630415 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:41.639555 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630419 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630423 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630427 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630430 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630433 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630436 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630438 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630441 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630444 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630446 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630449 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630453 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630456 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630458 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630461 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630463 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630467 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630470 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630472 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:41.640023 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630475 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630478 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630480 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630483 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630485 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630488 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630490 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630493 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630496 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630499 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630502 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630505 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630507 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630509 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630512 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630515 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630517 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630520 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630522 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630524 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:41.640504 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630527 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630530 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630532 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630534 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.630538 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.631562 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.640496 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.640515 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.640537 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.640547 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640609 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640615 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640618 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640622 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640625 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:41.640979 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640627 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640630 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640633 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640635 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640638 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640641 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640643 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640646 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640648 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640651 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640653 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640655 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640658 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640660 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640663 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640665 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640668 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640670 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640673 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640676 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:41.641338 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640679 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640681 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640684 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640689 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640693 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640696 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640699 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640703 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640707 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640710 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640712 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640715 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640717 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640720 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640722 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640725 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640727 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640730 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640732 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:41.641847 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640735 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640737 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640740 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640743 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640745 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640748 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640751 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640753 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640756 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640758 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640761 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640763 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640766 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640768 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640771 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640773 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640776 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640779 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640782 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640786 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:41.642330 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640789 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640792 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640795 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640798 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640800 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640803 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640806 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640808 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640811 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640813 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640816 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640818 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640820 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640823 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640825 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640828 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640831 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640833 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640836 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:41.642841 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640838 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640840 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640843 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640846 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640848 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640850 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640853 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640856 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640859 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640861 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640864 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640867 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640869 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640872 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640874 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:41.643289 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.640877 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.640882 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641033 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641039 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641042 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641045 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641048 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641050 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641053 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641056 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641059 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641061 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641064 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641067 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641070 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 08 19:01:41.643699 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641072 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641075 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641077 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641080 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641082 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641085 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641087 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641090 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641093 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641096 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641099 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641102 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641105 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641107 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641110 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641113 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641115 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641117 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641120 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641122 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 19:01:41.644072 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641125 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641127 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641130 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641132 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641136 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641139 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641142 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641145 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641147 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641150 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641153 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641155 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641158 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641161 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641163 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641165 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641168 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641170 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641172 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 19:01:41.644565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641175 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641177 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641180 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641182 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641185 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641188 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641191 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641193 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641196 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641198 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641200 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641203 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641205 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641208 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641210 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641212 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641215 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641217 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641219 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641222 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 19:01:41.645028 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641224 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641227 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641229 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641233 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641236 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641238 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641242 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641246 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641248 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641251 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641254 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641257 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641259 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641262 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641265 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641268 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641270 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641273 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641275 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 19:01:41.645534 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641278 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641281 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641283 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641285 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641288 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641290 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641293 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:41.641295 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.641299 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.641456 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 19:01:41.645986 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.645089 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 19:01:41.646814 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.646801 2560 server.go:1019] "Starting client certificate rotation" Jul 08 19:01:41.646921 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.646903 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:01:41.646954 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.646945 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 19:01:41.650099 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.650085 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:01:41.652420 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.652405 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 19:01:41.668205 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.668178 2560 log.go:25] "Validated CRI v1 runtime API" Jul 08 19:01:41.670615 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.670594 2560 log.go:25] "Validated CRI v1 image API" Jul 08 19:01:41.671541 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.671522 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 19:01:41.674068 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.674047 2560 fs.go:135] Filesystem UUIDs: map[4169238e-0f40-4d12-8034-d44a577bd004:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a64305c7-ebc2-481a-b885-0f665a09d694:/dev/nvme0n1p4] Jul 08 19:01:41.674144 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.674067 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 19:01:41.679580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.679547 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:01:41.681096 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.680979 2560 manager.go:216] Machine: {Timestamp:2026-07-08 19:01:41.679274882 +0000 UTC m=+0.370266395 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098433 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec295b029649382a7ead97278b220037 SystemUUID:ec295b02-9649-382a-7ead-97278b220037 BootID:709ebd32-7ea3-4e02-9f8b-d2e3f1615501 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:4c:95:c5:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:4c:95:c5:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:3e:4b:f5:14:0f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 19:01:41.681096 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.681092 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 19:01:41.681198 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.681190 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 19:01:41.684710 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.684679 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 19:01:41.684862 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.684713 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-210.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 19:01:41.685468 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.685456 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 19:01:41.685500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.685470 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 19:01:41.685500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.685478 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:01:41.685500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.685494 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 19:01:41.686891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.686880 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 19:01:41.689901 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.689887 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:01:41.690088 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.690078 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 19:01:41.690125 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.690115 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 08 19:01:41.690154 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.690125 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 19:01:41.690154 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.690138 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 19:01:41.690154 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.690148 2560 kubelet.go:398] "Adding apiserver pod source" Jul 08 19:01:41.690247 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.690160 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 19:01:41.690594 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.690582 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:01:41.690661 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.690602 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 19:01:41.692882 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.692862 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 19:01:41.694828 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.694814 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 19:01:41.694883 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.694846 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 19:01:41.696114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696099 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696117 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696125 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696130 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696139 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696144 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696155 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696164 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696173 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696181 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 19:01:41.696195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696199 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 19:01:41.696455 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.696207 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 19:01:41.697092 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.697081 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 19:01:41.697092 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.697092 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 19:01:41.700752 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.700729 2560 server.go:1268] "Started kubelet" Jul 08 19:01:41.700859 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.700826 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 19:01:41.700928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.700817 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 19:01:41.700928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.700908 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 19:01:41.701625 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.701596 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 19:01:41.701730 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.701675 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 19:01:41.701730 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.701696 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-210.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 19:01:41.701736 ip-10-0-129-210 systemd[1]: Started Kubernetes Kubelet. Jul 08 19:01:41.702718 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.702695 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 19:01:41.702868 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.702828 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 08 19:01:41.703016 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.702998 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7p6wn" Jul 08 19:01:41.706669 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.705898 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-210.ec2.internal.18c065b9ef87678c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-210.ec2.internal,UID:ip-10-0-129-210.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-210.ec2.internal,},FirstTimestamp:2026-07-08 19:01:41.700700044 +0000 UTC m=+0.391691562,LastTimestamp:2026-07-08 19:01:41.700700044 +0000 UTC m=+0.391691562,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-210.ec2.internal,}" Jul 08 19:01:41.707461 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.707442 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 19:01:41.707461 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.707453 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 19:01:41.708410 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.708370 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 19:01:41.708410 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.708411 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 19:01:41.708587 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.708574 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 08 19:01:41.708587 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.708587 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 08 19:01:41.708849 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.708818 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 19:01:41.708958 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.708920 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 19:01:41.709019 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.708973 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:41.709721 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.709697 2560 factory.go:55] Registering systemd factory Jul 08 19:01:41.709810 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.709726 2560 factory.go:223] Registration of the systemd container factory successfully Jul 08 19:01:41.710030 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.710013 2560 factory.go:153] Registering CRI-O factory Jul 08 19:01:41.710088 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.710039 2560 factory.go:223] Registration of the crio container factory successfully Jul 08 19:01:41.710130 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.710104 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 19:01:41.710178 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.710131 2560 factory.go:103] Registering Raw factory Jul 08 19:01:41.710178 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.710149 2560 manager.go:1196] Started watching for new ooms in manager Jul 08 19:01:41.710983 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.710968 2560 manager.go:349] Starting recovery of all containers Jul 08 19:01:41.712427 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.712257 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7p6wn" Jul 08 19:01:41.718437 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.718406 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-210.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 19:01:41.718567 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.718537 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 19:01:41.722781 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.722600 2560 manager.go:354] Recovery completed Jul 08 19:01:41.724089 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.724057 2560 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 08 19:01:41.727184 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.727172 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:41.729215 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.729194 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:41.729307 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.729232 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:41.729307 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.729244 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:41.729872 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.729859 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 19:01:41.729872 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.729872 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 19:01:41.729949 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.729888 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 08 19:01:41.729949 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.729899 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:41.730673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.730658 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:41.730718 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.730687 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:41.730718 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.730696 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:41.731236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.731221 2560 policy_none.go:49] "None policy: Start" Jul 08 19:01:41.731236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.731238 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 19:01:41.731412 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.731248 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 19:01:41.731412 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.731178 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-210.ec2.internal.18c065b9f13a7cd0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-210.ec2.internal,UID:ip-10-0-129-210.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-210.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-210.ec2.internal,},FirstTimestamp:2026-07-08 19:01:41.729213648 +0000 UTC m=+0.420205170,LastTimestamp:2026-07-08 19:01:41.729213648 +0000 UTC m=+0.420205170,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-210.ec2.internal,}" Jul 08 19:01:41.732759 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.732748 2560 policy_none.go:47] "Start" Jul 08 19:01:41.778123 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.778109 2560 manager.go:337] "Starting Device Plugin manager" Jul 08 19:01:41.778202 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.778144 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 19:01:41.778202 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.778156 2560 server.go:87] "Starting device plugin registration server" Jul 08 19:01:41.778740 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.778726 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 19:01:41.778803 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.778743 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 19:01:41.778849 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.778819 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 19:01:41.778916 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.778903 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 19:01:41.778916 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.778916 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 19:01:41.779556 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.779536 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 19:01:41.779626 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.779594 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:41.879911 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.879809 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:41.881219 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.880961 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:41.881219 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.880997 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:41.881219 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.881009 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:41.881219 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.881036 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-210.ec2.internal" Jul 08 19:01:41.887776 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.887756 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-210.ec2.internal" Jul 08 19:01:41.887914 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.887785 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-210.ec2.internal\": node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:41.904769 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.904741 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:41.950756 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.950715 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 19:01:41.952084 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.952063 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 19:01:41.952148 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.952117 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 19:01:41.952197 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.952148 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 19:01:41.952244 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:41.952192 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 19:01:41.954591 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:41.954570 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:42.005864 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.005828 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.052457 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.052407 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal"] Jul 08 19:01:42.052586 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.052506 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:42.053994 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.053980 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:42.054065 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.054009 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:42.054065 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.054019 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:42.055982 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.055955 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:42.056101 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.056059 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.056101 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.056094 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:42.057047 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.057029 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:42.057124 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.057056 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:42.057124 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.057066 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:42.057124 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.057034 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:42.057217 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.057143 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:42.057217 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.057161 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:42.058529 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.058515 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.058575 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.058542 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 19:01:42.059244 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.059228 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientMemory" Jul 08 19:01:42.059293 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.059257 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 19:01:42.059293 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.059272 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeHasSufficientPID" Jul 08 19:01:42.081181 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.081156 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-210.ec2.internal\" not found" node="ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.085498 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.085479 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-210.ec2.internal\" not found" node="ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.106545 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.106521 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.112112 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.112093 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be75a4634d4c840a01a4d3abbda7f26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal\" (UID: \"be75a4634d4c840a01a4d3abbda7f26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.112246 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.112120 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be75a4634d4c840a01a4d3abbda7f26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal\" (UID: \"be75a4634d4c840a01a4d3abbda7f26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.112246 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.112144 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39f89880c7f4aecc1e0e5b84b9c26123-config\") pod \"kube-apiserver-proxy-ip-10-0-129-210.ec2.internal\" (UID: \"39f89880c7f4aecc1e0e5b84b9c26123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.207454 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.207357 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.212758 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.212720 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be75a4634d4c840a01a4d3abbda7f26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal\" (UID: \"be75a4634d4c840a01a4d3abbda7f26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.212758 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.212756 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39f89880c7f4aecc1e0e5b84b9c26123-config\") pod \"kube-apiserver-proxy-ip-10-0-129-210.ec2.internal\" (UID: \"39f89880c7f4aecc1e0e5b84b9c26123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.212951 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.212774 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be75a4634d4c840a01a4d3abbda7f26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal\" (UID: \"be75a4634d4c840a01a4d3abbda7f26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.212951 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.212826 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39f89880c7f4aecc1e0e5b84b9c26123-config\") pod \"kube-apiserver-proxy-ip-10-0-129-210.ec2.internal\" (UID: \"39f89880c7f4aecc1e0e5b84b9c26123\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.212951 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.212830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be75a4634d4c840a01a4d3abbda7f26b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal\" (UID: \"be75a4634d4c840a01a4d3abbda7f26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.212951 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.212875 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be75a4634d4c840a01a4d3abbda7f26b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal\" (UID: \"be75a4634d4c840a01a4d3abbda7f26b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.307915 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.307874 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.384342 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.384310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.389111 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.388738 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" Jul 08 19:01:42.408110 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.408079 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.508671 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.508559 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.609746 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.609711 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.647479 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.647448 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 19:01:42.647903 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.647637 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 19:01:42.710919 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.710887 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.720423 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.720365 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:56:42 +0000 UTC" deadline="2028-04-08 06:31:33.380609166 +0000 UTC" Jul 08 19:01:42.720502 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.720424 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15347h29m50.660191651s" Jul 08 19:01:42.811355 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.811264 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.912123 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:42.912079 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:42.983285 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:42.983247 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe75a4634d4c840a01a4d3abbda7f26b.slice/crio-cb28ad1197bc478af0e87344096ce8fdb7bb23b8578f335f01508058fe3a66d3 WatchSource:0}: Error finding container cb28ad1197bc478af0e87344096ce8fdb7bb23b8578f335f01508058fe3a66d3: Status 404 returned error can't find the container with id cb28ad1197bc478af0e87344096ce8fdb7bb23b8578f335f01508058fe3a66d3 Jul 08 19:01:42.983565 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:42.983545 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f89880c7f4aecc1e0e5b84b9c26123.slice/crio-c49ddf0f093734a13d82d26e3915eeadced1dd1f2934d756835c2d9406932ad7 WatchSource:0}: Error finding container c49ddf0f093734a13d82d26e3915eeadced1dd1f2934d756835c2d9406932ad7: Status 404 returned error can't find the container with id c49ddf0f093734a13d82d26e3915eeadced1dd1f2934d756835c2d9406932ad7 Jul 08 19:01:42.988546 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:42.988527 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:01:43.012985 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.012948 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:43.115158 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.115072 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-210.ec2.internal\" not found" Jul 08 19:01:43.117495 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.117477 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:43.150680 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.150652 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:43.210065 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.210030 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:43.313619 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.313578 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" Jul 08 19:01:43.327305 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.327271 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:01:43.328497 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.328475 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" Jul 08 19:01:43.337769 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.337746 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 19:01:43.691376 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.691335 2560 apiserver.go:52] "Watching apiserver" Jul 08 19:01:43.698303 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.698261 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 19:01:43.698739 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.698711 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw","openshift-image-registry/node-ca-4fmgw","openshift-network-operator/iptables-alerter-wsp24","openshift-ovn-kubernetes/ovnkube-node-dtsff","kube-system/global-pull-secret-syncer-2h4tw","openshift-cluster-node-tuning-operator/tuned-4hxc9","openshift-dns/node-resolver-vxj69","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal","openshift-multus/multus-4ffqm","openshift-multus/multus-additional-cni-plugins-xm2ds","openshift-multus/network-metrics-daemon-vk797","openshift-network-diagnostics/network-check-target-2slmq","kube-system/konnectivity-agent-cdphm"] Jul 08 19:01:43.700912 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.700883 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.702492 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.702471 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:43.702627 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.702562 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:01:43.703168 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.703147 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dkf2w\"" Jul 08 19:01:43.703976 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.703954 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:43.704239 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.704220 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:43.705683 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.705658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.707131 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.706475 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.708708 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.708667 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.711133 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.711108 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 19:01:43.711421 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.711390 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 19:01:43.711741 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.711719 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 19:01:43.711987 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.711970 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9rgkq\"" Jul 08 19:01:43.712259 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.712245 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 19:01:43.712602 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.712585 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jx8mk\"" Jul 08 19:01:43.712896 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.712864 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 19:01:43.713109 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.713092 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:01:43.713361 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.713343 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 19:01:43.715378 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.715356 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 19:01:43.715670 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.715650 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 19:01:43.715929 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.715656 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-77vqq\"" Jul 08 19:01:43.716027 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.716012 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 19:01:43.716158 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.716142 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 19:01:43.716210 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.716187 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 19:01:43.716265 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.716214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.716322 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.716294 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:43.716378 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.716321 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 19:01:43.719576 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.719453 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:43.720208 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-ovn\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.720309 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-run\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.720309 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720249 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:43.720309 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720276 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vw2b\" (UniqueName: \"kubernetes.io/projected/d62a6106-3277-43a7-b7c8-d4584ff83871-kube-api-access-4vw2b\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.720309 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720304 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-env-overrides\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cc34c95-fd99-488a-9325-4056ffe2c48a-kubelet-config\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720355 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-modprobe-d\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720377 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-kubelet\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720403 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-run-netns\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720429 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-var-lib-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720453 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cc34c95-fd99-488a-9325-4056ffe2c48a-dbus\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-host-slash\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysconfig\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720557 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysctl-d\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720584 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-systemd\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxdsv\" (UniqueName: \"kubernetes.io/projected/67768928-2e75-4b16-b11b-7713d0fe6720-kube-api-access-jxdsv\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720660 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d62a6106-3277-43a7-b7c8-d4584ff83871-serviceca\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-iptables-alerter-script\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720716 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-lib-modules\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720758 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bns78\" (UniqueName: \"kubernetes.io/projected/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-kube-api-access-bns78\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.720794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720855 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-cni-bin\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-cni-netd\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720912 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovnkube-config\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovn-node-metrics-cert\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.720962 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgq6p\" (UniqueName: \"kubernetes.io/projected/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-kube-api-access-dgq6p\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721015 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysctl-conf\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721072 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67768928-2e75-4b16-b11b-7713d0fe6720-tmp\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-systemd\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721193 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-etc-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721226 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-node-log\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721295 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovnkube-script-lib\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-host\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721416 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-kubernetes\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.721580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721442 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-sys\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721470 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-var-lib-kubelet\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721515 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67768928-2e75-4b16-b11b-7713d0fe6720-etc-tuned\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721553 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d62a6106-3277-43a7-b7c8-d4584ff83871-host\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721587 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-log-socket\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721633 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-systemd-units\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721700 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-slash\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721902 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721919 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6s5dl\"" Jul 08 19:01:43.722310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.721924 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 19:01:43.722922 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.722905 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.724987 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.724942 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gsc9h\"" Jul 08 19:01:43.725158 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.725138 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 19:01:43.725234 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.725217 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.726030 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.725744 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 19:01:43.728255 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.726556 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.728255 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.727388 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 19:01:43.728255 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.727619 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9znjg\"" Jul 08 19:01:43.728255 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.727794 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 19:01:43.728255 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.728079 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 19:01:43.728255 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.728215 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 19:01:43.728674 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.728656 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 19:01:43.729172 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.728967 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 19:01:43.729460 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.729442 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.729759 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.729740 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4dp5p\"" Jul 08 19:01:43.729980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.729964 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 19:01:43.731092 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.731068 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:43.731192 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.731146 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:43.733745 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.733720 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vsl44\"" Jul 08 19:01:43.733850 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.733720 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 19:01:43.733976 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.733955 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 19:01:43.735078 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.735055 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 19:01:43.753436 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.753289 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dw92j" Jul 08 19:01:43.763697 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.763225 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dw92j" Jul 08 19:01:43.810904 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.810872 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 19:01:43.822887 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.822847 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bns78\" (UniqueName: \"kubernetes.io/projected/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-kube-api-access-bns78\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.823060 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.822895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.823060 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.822932 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxf99\" (UniqueName: \"kubernetes.io/projected/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-kube-api-access-pxf99\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.823060 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.822958 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-os-release\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.823060 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.822981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-socket-dir-parent\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.823060 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823005 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-system-cni-dir\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.823060 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823033 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgq6p\" (UniqueName: \"kubernetes.io/projected/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-kube-api-access-dgq6p\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.823060 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823056 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-socket-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823080 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-netns\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823103 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-cnibin\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823125 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-os-release\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823148 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823172 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823194 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysctl-conf\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823268 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-node-log\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823295 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823304 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-cni-multus\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.823429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823338 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/668651a4-1aee-4e06-bae1-f9db7d554099-agent-certs\") pod \"konnectivity-agent-cdphm\" (UID: \"668651a4-1aee-4e06-bae1-f9db7d554099\") " pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823612 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysctl-conf\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823656 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-sys\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823688 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-node-log\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823734 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-log-socket\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823762 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-slash\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823814 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-sys\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823858 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-ovn\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-run\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823911 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-log-socket\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823954 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vw2b\" (UniqueName: \"kubernetes.io/projected/d62a6106-3277-43a7-b7c8-d4584ff83871-kube-api-access-4vw2b\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.823984 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-device-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.824029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-modprobe-d\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824054 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-kubelet\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597s9\" (UniqueName: \"kubernetes.io/projected/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-kube-api-access-597s9\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysctl-d\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-systemd\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824185 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-slash\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824262 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-systemd\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824311 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-kubelet\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824314 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-modprobe-d\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824395 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-run\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824681 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824471 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysctl-d\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824681 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824508 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-ovn\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824681 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824541 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxdsv\" (UniqueName: \"kubernetes.io/projected/67768928-2e75-4b16-b11b-7713d0fe6720-kube-api-access-jxdsv\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824681 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-iptables-alerter-script\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.824681 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824599 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-cni-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.824681 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824635 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-kubelet\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.824681 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt4jd\" (UniqueName: \"kubernetes.io/projected/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-kube-api-access-nt4jd\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.824891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-cni-bin\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-cni-netd\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824753 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovn-node-metrics-cert\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824778 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.824891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovnkube-config\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.824891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-k8s-cni-cncf-io\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.824891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67768928-2e75-4b16-b11b-7713d0fe6720-tmp\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.824891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.824883 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-systemd\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.832559 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-etc-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.832728 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832598 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-hosts-file\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.832728 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832631 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-cni-bin\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.832728 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.832902 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-host\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.832902 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832776 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-kubernetes\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.832902 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832811 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-var-lib-kubelet\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.832902 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832858 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67768928-2e75-4b16-b11b-7713d0fe6720-etc-tuned\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.832902 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832884 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d62a6106-3277-43a7-b7c8-d4584ff83871-host\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.833068 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832918 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.833068 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832954 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-tmp-dir\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.833068 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.832991 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-system-cni-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.833068 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833024 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-systemd-units\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.833233 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833198 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-cnibin\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.833292 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833233 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-cni-binary-copy\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.833292 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-hostroot\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.833397 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833312 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-daemon-config\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.833397 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.833397 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833381 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:43.833548 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833415 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-env-overrides\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.833548 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833449 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cc34c95-fd99-488a-9325-4056ffe2c48a-kubelet-config\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.833548 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-sys-fs\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.833548 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833530 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-multus-certs\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.833673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833567 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-run-netns\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.833673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833589 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-cni-bin\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.833673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833603 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-var-lib-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.833673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833662 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-var-lib-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.833673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833665 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cc34c95-fd99-488a-9325-4056ffe2c48a-dbus\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.833822 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833704 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-registration-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.833822 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833738 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.833822 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833770 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p4nt\" (UniqueName: \"kubernetes.io/projected/9c970e29-f821-46b8-ad53-970a11060b2b-kube-api-access-6p4nt\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.833822 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833803 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-conf-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.833946 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833838 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-etc-kubernetes\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.833946 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833872 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovnkube-script-lib\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.833946 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.834104 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.834075 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-systemd-units\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.834197 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.834177 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-host\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.834257 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.834237 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-kubernetes\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.834328 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.834309 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-var-lib-kubelet\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.834757 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.834730 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d62a6106-3277-43a7-b7c8-d4584ff83871-host\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.834857 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.834744 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 19:01:43.834857 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.834793 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.835680 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.835649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-env-overrides\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.835790 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.835756 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4cc34c95-fd99-488a-9325-4056ffe2c48a-kubelet-config\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.835790 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.833532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-systemd\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.835906 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.835842 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-run-netns\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.835906 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.835892 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-host-cni-netd\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.836405 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.836369 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-host-slash\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.836514 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.836448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysconfig\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.836514 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.836490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d62a6106-3277-43a7-b7c8-d4584ff83871-serviceca\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.836624 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.836526 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.836757 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.836577 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sphp7\" (UniqueName: \"kubernetes.io/projected/8d1ed88f-1103-4016-8544-4729840f472d-kube-api-access-sphp7\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.837002 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.836774 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-etc-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.837002 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.836790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/668651a4-1aee-4e06-bae1-f9db7d554099-konnectivity-ca\") pod \"konnectivity-agent-cdphm\" (UID: \"668651a4-1aee-4e06-bae1-f9db7d554099\") " pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:43.837002 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.836837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-lib-modules\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.837148 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.837093 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-lib-modules\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.837256 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.837236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4cc34c95-fd99-488a-9325-4056ffe2c48a-dbus\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:43.837367 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.837348 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:43.837509 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.837480 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret podName:4cc34c95-fd99-488a-9325-4056ffe2c48a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:44.337441451 +0000 UTC m=+3.028432971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret") pod "global-pull-secret-syncer-2h4tw" (UID: "4cc34c95-fd99-488a-9325-4056ffe2c48a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:43.838098 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.838072 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovnkube-script-lib\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.838313 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.838290 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-iptables-alerter-script\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.838617 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.838591 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-host-slash\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.838708 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.838667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/67768928-2e75-4b16-b11b-7713d0fe6720-etc-sysconfig\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.838764 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.838749 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-run-openvswitch\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.839188 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.839163 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d62a6106-3277-43a7-b7c8-d4584ff83871-serviceca\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.839739 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.839714 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:43.839838 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.839753 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:43.839838 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.839767 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kkb76 for pod openshift-network-diagnostics/network-check-target-2slmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:43.839945 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.839847 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76 podName:9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:44.339829472 +0000 UTC m=+3.030820996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kkb76" (UniqueName: "kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76") pod "network-check-target-2slmq" (UID: "9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:43.839945 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.839913 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovnkube-config\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.845535 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.844835 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxdsv\" (UniqueName: \"kubernetes.io/projected/67768928-2e75-4b16-b11b-7713d0fe6720-kube-api-access-jxdsv\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.845535 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.845381 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67768928-2e75-4b16-b11b-7713d0fe6720-tmp\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.845535 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.845388 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/67768928-2e75-4b16-b11b-7713d0fe6720-etc-tuned\") pod \"tuned-4hxc9\" (UID: \"67768928-2e75-4b16-b11b-7713d0fe6720\") " pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:43.845761 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.845673 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-ovn-node-metrics-cert\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.845761 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.845686 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bns78\" (UniqueName: \"kubernetes.io/projected/9eb3fd25-3c73-4673-bb58-3a053a6cdf54-kube-api-access-bns78\") pod \"iptables-alerter-wsp24\" (UID: \"9eb3fd25-3c73-4673-bb58-3a053a6cdf54\") " pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:43.846604 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.846080 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgq6p\" (UniqueName: \"kubernetes.io/projected/db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4-kube-api-access-dgq6p\") pod \"ovnkube-node-dtsff\" (UID: \"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:43.847906 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.847881 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vw2b\" (UniqueName: \"kubernetes.io/projected/d62a6106-3277-43a7-b7c8-d4584ff83871-kube-api-access-4vw2b\") pod \"node-ca-4fmgw\" (UID: \"d62a6106-3277-43a7-b7c8-d4584ff83871\") " pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:43.937273 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937232 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597s9\" (UniqueName: \"kubernetes.io/projected/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-kube-api-access-597s9\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:43.937273 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937289 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-cni-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937311 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-kubelet\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937328 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt4jd\" (UniqueName: \"kubernetes.io/projected/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-kube-api-access-nt4jd\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937347 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937364 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-k8s-cni-cncf-io\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937394 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-hosts-file\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-hosts-file\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937538 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-k8s-cni-cncf-io\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937559 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-kubelet\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937612 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-cni-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-cni-bin\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937680 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937713 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-tmp-dir\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-system-cni-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937764 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-cnibin\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937778 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-system-cni-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937789 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-cni-binary-copy\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.939318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937817 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-cnibin\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-hostroot\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937842 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-daemon-config\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-sys-fs\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937931 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-multus-certs\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-registration-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937990 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p4nt\" (UniqueName: \"kubernetes.io/projected/9c970e29-f821-46b8-ad53-970a11060b2b-kube-api-access-6p4nt\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938039 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-conf-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938064 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-etc-kubernetes\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938108 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sphp7\" (UniqueName: \"kubernetes.io/projected/8d1ed88f-1103-4016-8544-4729840f472d-kube-api-access-sphp7\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938112 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-tmp-dir\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938133 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/668651a4-1aee-4e06-bae1-f9db7d554099-konnectivity-ca\") pod \"konnectivity-agent-cdphm\" (UID: \"668651a4-1aee-4e06-bae1-f9db7d554099\") " pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxf99\" (UniqueName: \"kubernetes.io/projected/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-kube-api-access-pxf99\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938182 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-multus-certs\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938189 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-os-release\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940156 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938227 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-socket-dir-parent\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938256 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-system-cni-dir\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938262 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-os-release\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938281 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-cni-binary-copy\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938285 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-socket-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938313 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-netns\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938330 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-registration-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938340 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-cnibin\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938367 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-sys-fs\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938392 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938402 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-socket-dir-parent\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938402 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.937740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-cni-bin\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938428 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-os-release\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-conf-dir\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-os-release\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938595 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-hostroot\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.940884 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-system-cni-dir\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938715 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-etc-kubernetes\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938776 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-cnibin\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938825 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-run-netns\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938896 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938924 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938929 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-socket-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938980 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.938992 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-multus-daemon-config\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939134 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8d1ed88f-1103-4016-8544-4729840f472d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.939211 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939248 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-cni-multus\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/668651a4-1aee-4e06-bae1-f9db7d554099-agent-certs\") pod \"konnectivity-agent-cdphm\" (UID: \"668651a4-1aee-4e06-bae1-f9db7d554099\") " pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939334 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-host-var-lib-cni-multus\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:43.939496 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs podName:eb492e2e-7cb5-43e7-b25e-4507b7fa2d28 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:44.439473984 +0000 UTC m=+3.130465497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs") pod "network-metrics-daemon-vk797" (UID: "eb492e2e-7cb5-43e7-b25e-4507b7fa2d28") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/668651a4-1aee-4e06-bae1-f9db7d554099-konnectivity-ca\") pod \"konnectivity-agent-cdphm\" (UID: \"668651a4-1aee-4e06-bae1-f9db7d554099\") " pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939601 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.941599 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-device-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.942310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939700 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8d1ed88f-1103-4016-8544-4729840f472d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.942310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.939800 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9c970e29-f821-46b8-ad53-970a11060b2b-device-dir\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:43.942515 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.942497 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/668651a4-1aee-4e06-bae1-f9db7d554099-agent-certs\") pod \"konnectivity-agent-cdphm\" (UID: \"668651a4-1aee-4e06-bae1-f9db7d554099\") " pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:43.949214 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.949175 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxf99\" (UniqueName: \"kubernetes.io/projected/08e8e9f1-6b00-4fba-af7b-7f20f63ebad8-kube-api-access-pxf99\") pod \"node-resolver-vxj69\" (UID: \"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8\") " pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:43.950733 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.950216 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-597s9\" (UniqueName: \"kubernetes.io/projected/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-kube-api-access-597s9\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:43.951657 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.951604 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sphp7\" (UniqueName: \"kubernetes.io/projected/8d1ed88f-1103-4016-8544-4729840f472d-kube-api-access-sphp7\") pod \"multus-additional-cni-plugins-xm2ds\" (UID: \"8d1ed88f-1103-4016-8544-4729840f472d\") " pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:43.954397 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.954373 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt4jd\" (UniqueName: \"kubernetes.io/projected/6c13a6c5-5b12-4118-9122-74c8b9ecd5b9-kube-api-access-nt4jd\") pod \"multus-4ffqm\" (UID: \"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9\") " pod="openshift-multus/multus-4ffqm" Jul 08 19:01:43.958432 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.958377 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" event={"ID":"be75a4634d4c840a01a4d3abbda7f26b","Type":"ContainerStarted","Data":"cb28ad1197bc478af0e87344096ce8fdb7bb23b8578f335f01508058fe3a66d3"} Jul 08 19:01:43.960753 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.960723 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" event={"ID":"39f89880c7f4aecc1e0e5b84b9c26123","Type":"ContainerStarted","Data":"c49ddf0f093734a13d82d26e3915eeadced1dd1f2934d756835c2d9406932ad7"} Jul 08 19:01:43.962113 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:43.962093 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p4nt\" (UniqueName: \"kubernetes.io/projected/9c970e29-f821-46b8-ad53-970a11060b2b-kube-api-access-6p4nt\") pod \"aws-ebs-csi-driver-node-2xhvw\" (UID: \"9c970e29-f821-46b8-ad53-970a11060b2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:44.026577 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.026541 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" Jul 08 19:01:44.036195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.036166 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4fmgw" Jul 08 19:01:44.037164 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.037128 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67768928_2e75_4b16_b11b_7713d0fe6720.slice/crio-d5dd9e555687bbb3d4ca7e5cbb377ef94effcdb9d5049e9840d461ad22984c58 WatchSource:0}: Error finding container d5dd9e555687bbb3d4ca7e5cbb377ef94effcdb9d5049e9840d461ad22984c58: Status 404 returned error can't find the container with id d5dd9e555687bbb3d4ca7e5cbb377ef94effcdb9d5049e9840d461ad22984c58 Jul 08 19:01:44.046302 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.046269 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62a6106_3277_43a7_b7c8_d4584ff83871.slice/crio-5e9dda5cc4d4223ef1b65016bd8a9b1770c618acc2874cddac27d16ae412dccd WatchSource:0}: Error finding container 5e9dda5cc4d4223ef1b65016bd8a9b1770c618acc2874cddac27d16ae412dccd: Status 404 returned error can't find the container with id 5e9dda5cc4d4223ef1b65016bd8a9b1770c618acc2874cddac27d16ae412dccd Jul 08 19:01:44.050818 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.050795 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wsp24" Jul 08 19:01:44.056781 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.056753 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:01:44.060685 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.060657 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb3fd25_3c73_4673_bb58_3a053a6cdf54.slice/crio-91b9ee17624cdd912ce44adb08c4d0f93fe73e08f45d9e32e5cda811ecdf3078 WatchSource:0}: Error finding container 91b9ee17624cdd912ce44adb08c4d0f93fe73e08f45d9e32e5cda811ecdf3078: Status 404 returned error can't find the container with id 91b9ee17624cdd912ce44adb08c4d0f93fe73e08f45d9e32e5cda811ecdf3078 Jul 08 19:01:44.062391 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.062218 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:44.066566 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.066536 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb0ea9b0_74a0_4e2d_9bf4_f7cac85278a4.slice/crio-342b28b682bde40c74ab4f2de36a0554687d19c7474f65274c8c35975d353936 WatchSource:0}: Error finding container 342b28b682bde40c74ab4f2de36a0554687d19c7474f65274c8c35975d353936: Status 404 returned error can't find the container with id 342b28b682bde40c74ab4f2de36a0554687d19c7474f65274c8c35975d353936 Jul 08 19:01:44.070583 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.070557 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vxj69" Jul 08 19:01:44.072677 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.072647 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod668651a4_1aee_4e06_bae1_f9db7d554099.slice/crio-d7b66c49726126398b13a9b2a2a6dbb7277e2f1fade0be2b4eeb0f27cbcd431d WatchSource:0}: Error finding container d7b66c49726126398b13a9b2a2a6dbb7277e2f1fade0be2b4eeb0f27cbcd431d: Status 404 returned error can't find the container with id d7b66c49726126398b13a9b2a2a6dbb7277e2f1fade0be2b4eeb0f27cbcd431d Jul 08 19:01:44.080359 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.080338 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" Jul 08 19:01:44.081196 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.081167 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e8e9f1_6b00_4fba_af7b_7f20f63ebad8.slice/crio-dc38959cae0117fcb63a4e67a0e90c414d08de4d36af327a6c4503a8d6e41855 WatchSource:0}: Error finding container dc38959cae0117fcb63a4e67a0e90c414d08de4d36af327a6c4503a8d6e41855: Status 404 returned error can't find the container with id dc38959cae0117fcb63a4e67a0e90c414d08de4d36af327a6c4503a8d6e41855 Jul 08 19:01:44.091227 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.091194 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c970e29_f821_46b8_ad53_970a11060b2b.slice/crio-cddf26ec7a1bf7f8680cab3022ed3737e27960217247dcfdb523adf6c3333fc4 WatchSource:0}: Error finding container cddf26ec7a1bf7f8680cab3022ed3737e27960217247dcfdb523adf6c3333fc4: Status 404 returned error can't find the container with id cddf26ec7a1bf7f8680cab3022ed3737e27960217247dcfdb523adf6c3333fc4 Jul 08 19:01:44.092281 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.092260 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4ffqm" Jul 08 19:01:44.101071 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.101047 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" Jul 08 19:01:44.102683 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.102642 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c13a6c5_5b12_4118_9122_74c8b9ecd5b9.slice/crio-f3613af5a4c3a502a1c47fc2f61e565d9beccc9c7d35b12b91272c6b8ddbc230 WatchSource:0}: Error finding container f3613af5a4c3a502a1c47fc2f61e565d9beccc9c7d35b12b91272c6b8ddbc230: Status 404 returned error can't find the container with id f3613af5a4c3a502a1c47fc2f61e565d9beccc9c7d35b12b91272c6b8ddbc230 Jul 08 19:01:44.112040 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:01:44.112011 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1ed88f_1103_4016_8544_4729840f472d.slice/crio-449dece8fa7dd92be0d37b830138325efb5beb7381bb5c44cbcbb7079daba344 WatchSource:0}: Error finding container 449dece8fa7dd92be0d37b830138325efb5beb7381bb5c44cbcbb7079daba344: Status 404 returned error can't find the container with id 449dece8fa7dd92be0d37b830138325efb5beb7381bb5c44cbcbb7079daba344 Jul 08 19:01:44.125926 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.125902 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 19:01:44.343567 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.343468 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:44.343567 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.343549 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:44.343801 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.343685 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:44.343801 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.343713 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:44.343801 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.343734 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:44.343801 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.343747 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kkb76 for pod openshift-network-diagnostics/network-check-target-2slmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:44.343801 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.343768 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret podName:4cc34c95-fd99-488a-9325-4056ffe2c48a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:45.343746202 +0000 UTC m=+4.034737706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret") pod "global-pull-secret-syncer-2h4tw" (UID: "4cc34c95-fd99-488a-9325-4056ffe2c48a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:44.343801 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.343787 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76 podName:9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:45.343775571 +0000 UTC m=+4.034767071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kkb76" (UniqueName: "kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76") pod "network-check-target-2slmq" (UID: "9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:44.444129 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.444083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:44.444312 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.444229 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:44.444312 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.444308 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs podName:eb492e2e-7cb5-43e7-b25e-4507b7fa2d28 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:45.444291992 +0000 UTC m=+4.135283493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs") pod "network-metrics-daemon-vk797" (UID: "eb492e2e-7cb5-43e7-b25e-4507b7fa2d28") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:44.766774 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.766715 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:56:44 +0000 UTC" deadline="2028-03-10 22:35:30.137445282 +0000 UTC" Jul 08 19:01:44.766774 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.766772 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14667h33m45.370679072s" Jul 08 19:01:44.953167 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.952696 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:44.953167 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:44.952838 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:44.964046 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.964000 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"342b28b682bde40c74ab4f2de36a0554687d19c7474f65274c8c35975d353936"} Jul 08 19:01:44.965482 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.965436 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wsp24" event={"ID":"9eb3fd25-3c73-4673-bb58-3a053a6cdf54","Type":"ContainerStarted","Data":"91b9ee17624cdd912ce44adb08c4d0f93fe73e08f45d9e32e5cda811ecdf3078"} Jul 08 19:01:44.966762 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.966730 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4fmgw" event={"ID":"d62a6106-3277-43a7-b7c8-d4584ff83871","Type":"ContainerStarted","Data":"5e9dda5cc4d4223ef1b65016bd8a9b1770c618acc2874cddac27d16ae412dccd"} Jul 08 19:01:44.972981 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.972935 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" event={"ID":"67768928-2e75-4b16-b11b-7713d0fe6720","Type":"ContainerStarted","Data":"d5dd9e555687bbb3d4ca7e5cbb377ef94effcdb9d5049e9840d461ad22984c58"} Jul 08 19:01:44.974446 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.974412 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" event={"ID":"8d1ed88f-1103-4016-8544-4729840f472d","Type":"ContainerStarted","Data":"449dece8fa7dd92be0d37b830138325efb5beb7381bb5c44cbcbb7079daba344"} Jul 08 19:01:44.975797 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.975766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4ffqm" event={"ID":"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9","Type":"ContainerStarted","Data":"f3613af5a4c3a502a1c47fc2f61e565d9beccc9c7d35b12b91272c6b8ddbc230"} Jul 08 19:01:44.977105 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.977081 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" event={"ID":"9c970e29-f821-46b8-ad53-970a11060b2b","Type":"ContainerStarted","Data":"cddf26ec7a1bf7f8680cab3022ed3737e27960217247dcfdb523adf6c3333fc4"} Jul 08 19:01:44.978504 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.978468 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vxj69" event={"ID":"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8","Type":"ContainerStarted","Data":"dc38959cae0117fcb63a4e67a0e90c414d08de4d36af327a6c4503a8d6e41855"} Jul 08 19:01:44.980137 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:44.980105 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdphm" event={"ID":"668651a4-1aee-4e06-bae1-f9db7d554099","Type":"ContainerStarted","Data":"d7b66c49726126398b13a9b2a2a6dbb7277e2f1fade0be2b4eeb0f27cbcd431d"} Jul 08 19:01:45.352020 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:45.351967 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:45.352215 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:45.352037 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:45.352215 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.352206 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:45.352352 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.352279 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret podName:4cc34c95-fd99-488a-9325-4056ffe2c48a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:47.352258973 +0000 UTC m=+6.043250480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret") pod "global-pull-secret-syncer-2h4tw" (UID: "4cc34c95-fd99-488a-9325-4056ffe2c48a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:45.352821 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.352796 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:45.352890 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.352829 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:45.352890 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.352844 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kkb76 for pod openshift-network-diagnostics/network-check-target-2slmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:45.352990 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.352897 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76 podName:9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:47.352879571 +0000 UTC m=+6.043871098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kkb76" (UniqueName: "kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76") pod "network-check-target-2slmq" (UID: "9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:45.452917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:45.452877 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:45.453138 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.453050 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:45.453138 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.453123 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs podName:eb492e2e-7cb5-43e7-b25e-4507b7fa2d28 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:47.453099436 +0000 UTC m=+6.144090940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs") pod "network-metrics-daemon-vk797" (UID: "eb492e2e-7cb5-43e7-b25e-4507b7fa2d28") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:45.767828 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:45.767733 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:56:44 +0000 UTC" deadline="2027-12-18 09:06:21.436405437 +0000 UTC" Jul 08 19:01:45.767828 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:45.767797 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12662h4m35.668612971s" Jul 08 19:01:45.956335 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:45.955034 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:45.956597 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:45.955475 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:45.956597 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.956500 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:45.956729 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:45.956601 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:01:45.986333 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:45.986198 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" event={"ID":"39f89880c7f4aecc1e0e5b84b9c26123","Type":"ContainerStarted","Data":"73fcf1a0fd37d38603e85240877ebfb0e3dd7ccdeb38c18081937756931bc36e"} Jul 08 19:01:46.953339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:46.953305 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:46.953855 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:46.953485 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:46.994493 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:46.994371 2560 generic.go:356] "Generic (PLEG): container finished" podID="be75a4634d4c840a01a4d3abbda7f26b" containerID="60363961ff85b649649d91a4d9dc43a62bff9fa876a08dde76c3ccd43651ad48" exitCode=0 Jul 08 19:01:46.995330 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:46.995294 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" event={"ID":"be75a4634d4c840a01a4d3abbda7f26b","Type":"ContainerDied","Data":"60363961ff85b649649d91a4d9dc43a62bff9fa876a08dde76c3ccd43651ad48"} Jul 08 19:01:47.010406 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:47.010324 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-210.ec2.internal" podStartSLOduration=3.010298467 podStartE2EDuration="3.010298467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:46.001516543 +0000 UTC m=+4.692508070" watchObservedRunningTime="2026-07-08 19:01:47.010298467 +0000 UTC m=+5.701289995" Jul 08 19:01:47.368559 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:47.368462 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:47.368559 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:47.368520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:47.368801 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.368703 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:47.368801 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.368771 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret podName:4cc34c95-fd99-488a-9325-4056ffe2c48a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:51.368751823 +0000 UTC m=+10.059743349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret") pod "global-pull-secret-syncer-2h4tw" (UID: "4cc34c95-fd99-488a-9325-4056ffe2c48a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:47.368914 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.368868 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:47.368914 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.368890 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:47.368914 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.368903 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kkb76 for pod openshift-network-diagnostics/network-check-target-2slmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:47.369060 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.368941 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76 podName:9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:51.368928836 +0000 UTC m=+10.059920342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kkb76" (UniqueName: "kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76") pod "network-check-target-2slmq" (UID: "9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:47.470203 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:47.469903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:47.470203 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.470044 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:47.470203 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.470104 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs podName:eb492e2e-7cb5-43e7-b25e-4507b7fa2d28 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:51.47008991 +0000 UTC m=+10.161081415 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs") pod "network-metrics-daemon-vk797" (UID: "eb492e2e-7cb5-43e7-b25e-4507b7fa2d28") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:47.953413 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:47.953367 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:47.953866 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:47.953414 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:47.953866 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.953554 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:01:47.953866 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:47.953684 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:48.952816 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:48.952778 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:48.953003 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:48.952950 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:49.953586 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:49.953552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:49.954076 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:49.953693 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:49.956342 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:49.954132 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:49.956342 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:49.954252 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:01:50.953111 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:50.953073 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:50.953304 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:50.953227 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:51.403913 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:51.403106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:51.403913 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:51.403173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:51.403913 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.403317 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:51.403913 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.403372 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret podName:4cc34c95-fd99-488a-9325-4056ffe2c48a nodeName:}" failed. No retries permitted until 2026-07-08 19:01:59.403356264 +0000 UTC m=+18.094347766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret") pod "global-pull-secret-syncer-2h4tw" (UID: "4cc34c95-fd99-488a-9325-4056ffe2c48a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:51.403913 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.403807 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:51.403913 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.403828 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:51.403913 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.403840 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kkb76 for pod openshift-network-diagnostics/network-check-target-2slmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:51.403913 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.403877 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76 podName:9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:59.403866109 +0000 UTC m=+18.094857611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kkb76" (UniqueName: "kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76") pod "network-check-target-2slmq" (UID: "9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:51.503660 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:51.503619 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:51.503906 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.503800 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:51.503906 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.503877 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs podName:eb492e2e-7cb5-43e7-b25e-4507b7fa2d28 nodeName:}" failed. No retries permitted until 2026-07-08 19:01:59.503856966 +0000 UTC m=+18.194848474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs") pod "network-metrics-daemon-vk797" (UID: "eb492e2e-7cb5-43e7-b25e-4507b7fa2d28") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:51.953444 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:51.953407 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:51.953634 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.953543 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:01:51.954027 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:51.954001 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:51.954189 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:51.954164 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:52.953411 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:52.953025 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:52.953411 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:52.953184 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:53.953654 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:53.953203 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:53.953654 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:53.953323 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:01:53.954172 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:53.953775 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:53.954172 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:53.953882 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:54.952798 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:54.952759 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:54.952976 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:54.952903 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:55.954204 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:55.953470 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:55.954204 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:55.953842 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:01:55.954745 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:55.954372 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:55.954745 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:55.954521 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:56.015536 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.015499 2560 generic.go:356] "Generic (PLEG): container finished" podID="8d1ed88f-1103-4016-8544-4729840f472d" containerID="8af340d9a63d3ab88f78ab2595b1d243dee327100ebeb6ea7a83973fc5a89590" exitCode=0 Jul 08 19:01:56.015688 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.015561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" event={"ID":"8d1ed88f-1103-4016-8544-4729840f472d","Type":"ContainerDied","Data":"8af340d9a63d3ab88f78ab2595b1d243dee327100ebeb6ea7a83973fc5a89590"} Jul 08 19:01:56.017722 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.017691 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" event={"ID":"9c970e29-f821-46b8-ad53-970a11060b2b","Type":"ContainerStarted","Data":"592047d1c806ac327f19656759ed5f7fda7169ac45360daf9f5c93f90b3a9c50"} Jul 08 19:01:56.019791 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.019767 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" event={"ID":"be75a4634d4c840a01a4d3abbda7f26b","Type":"ContainerStarted","Data":"8b0f6c795eb48a0d2dae94022fa6fa3a23c2e349b346346fd5073c76348218b0"} Jul 08 19:01:56.021460 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.021440 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vxj69" event={"ID":"08e8e9f1-6b00-4fba-af7b-7f20f63ebad8","Type":"ContainerStarted","Data":"0aff1800ddcacd338b3aa5cc0b75d84bcae2a407ef8939903eeeba78398216af"} Jul 08 19:01:56.023823 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.023482 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdphm" event={"ID":"668651a4-1aee-4e06-bae1-f9db7d554099","Type":"ContainerStarted","Data":"a1f9fb34981d7ed34fa45803ac316d4fda2c101b19eb9643e342b6bf45f581f5"} Jul 08 19:01:56.024926 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.024902 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4fmgw" event={"ID":"d62a6106-3277-43a7-b7c8-d4584ff83871","Type":"ContainerStarted","Data":"2dc4c01921848e22f5e0f4aad742b14157e10e341ae70592bc65e1e43f770bbf"} Jul 08 19:01:56.026285 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.026264 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" event={"ID":"67768928-2e75-4b16-b11b-7713d0fe6720","Type":"ContainerStarted","Data":"89e35291fe1128b8f7f5420eb246de2286d1abea18aebda01f387ea408bf6c53"} Jul 08 19:01:56.054791 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.054725 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-210.ec2.internal" podStartSLOduration=13.054702084 podStartE2EDuration="13.054702084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:56.054566828 +0000 UTC m=+14.745558352" watchObservedRunningTime="2026-07-08 19:01:56.054702084 +0000 UTC m=+14.745693608" Jul 08 19:01:56.067828 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.067756 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4fmgw" podStartSLOduration=2.954326358 podStartE2EDuration="14.067742287s" totalImagesPullingTime="11.113415929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:56.06766477 +0000 UTC m=+14.758656288" watchObservedRunningTime="2026-07-08 19:01:56.067742287 +0000 UTC m=+14.758733811" Jul 08 19:01:56.081697 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.081633 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cdphm" podStartSLOduration=8.793088526 podStartE2EDuration="14.081608621s" totalImagesPullingTime="5.288520095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:56.081149189 +0000 UTC m=+14.772140901" watchObservedRunningTime="2026-07-08 19:01:56.081608621 +0000 UTC m=+14.772600159" Jul 08 19:01:56.097829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.097768 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4hxc9" podStartSLOduration=2.739001903 podStartE2EDuration="14.097747838s" totalImagesPullingTime="11.358745935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:56.096869238 +0000 UTC m=+14.787860761" watchObservedRunningTime="2026-07-08 19:01:56.097747838 +0000 UTC m=+14.788739362" Jul 08 19:01:56.111673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.111611 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vxj69" podStartSLOduration=7.904949763 podStartE2EDuration="14.111588443s" totalImagesPullingTime="6.20663868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:56.110839064 +0000 UTC m=+14.801830586" watchObservedRunningTime="2026-07-08 19:01:56.111588443 +0000 UTC m=+14.802579968" Jul 08 19:01:56.953026 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:56.952988 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:56.953208 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:56.953147 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:57.031466 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.031358 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wsp24" event={"ID":"9eb3fd25-3c73-4673-bb58-3a053a6cdf54","Type":"ContainerStarted","Data":"c4e948a69f9253e0d863e83b2334888d9e6e6fe49c442665aa71e19228ddd8a1"} Jul 08 19:01:57.051198 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.051138 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wsp24" podStartSLOduration=3.95388589 podStartE2EDuration="15.05111671s" totalImagesPullingTime="11.09723082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:01:57.050110345 +0000 UTC m=+15.741101867" watchObservedRunningTime="2026-07-08 19:01:57.05111671 +0000 UTC m=+15.742108233" Jul 08 19:01:57.366472 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.366422 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 19:01:57.797176 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.797051 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T19:01:57.366447313Z","UUID":"33c1c4d8-a8a8-4dd0-b117-59d4ae19c5bc","Handler":null,"Name":"","Endpoint":""} Jul 08 19:01:57.799163 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.799141 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 19:01:57.799330 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.799179 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 19:01:57.860271 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.860234 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:57.860880 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.860857 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:01:57.955043 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.955013 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:57.955245 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:57.955178 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:01:57.955558 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:57.955530 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:57.955681 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:57.955649 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:58.038059 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:58.038021 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" event={"ID":"9c970e29-f821-46b8-ad53-970a11060b2b","Type":"ContainerStarted","Data":"10e1ab3fc68f3bc1720453d447d67f62ddbd447e69ba2d607a4badaf8ee56a9c"} Jul 08 19:01:58.952637 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:58.952599 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:58.952919 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:58.952739 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:01:59.040147 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:59.040110 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 19:01:59.474141 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:59.474105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:59.474368 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:59.474156 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:59.474368 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.474289 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:59.474368 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.474301 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:01:59.474368 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.474327 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:01:59.474368 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.474339 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kkb76 for pod openshift-network-diagnostics/network-check-target-2slmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:59.474368 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.474360 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret podName:4cc34c95-fd99-488a-9325-4056ffe2c48a nodeName:}" failed. No retries permitted until 2026-07-08 19:02:15.474340076 +0000 UTC m=+34.165331577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret") pod "global-pull-secret-syncer-2h4tw" (UID: "4cc34c95-fd99-488a-9325-4056ffe2c48a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:01:59.474725 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.474416 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76 podName:9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:15.474376087 +0000 UTC m=+34.165367590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kkb76" (UniqueName: "kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76") pod "network-check-target-2slmq" (UID: "9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:01:59.575416 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:59.575360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:01:59.575595 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.575541 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:59.575658 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.575622 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs podName:eb492e2e-7cb5-43e7-b25e-4507b7fa2d28 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:15.575600464 +0000 UTC m=+34.266591989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs") pod "network-metrics-daemon-vk797" (UID: "eb492e2e-7cb5-43e7-b25e-4507b7fa2d28") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:01:59.953148 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:59.953068 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:01:59.953307 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.953191 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:01:59.953510 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:01:59.953490 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:01:59.953629 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:01:59.953604 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:00.953013 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:00.952773 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:00.953526 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:00.953126 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:01.512480 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:01.512439 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:02:01.512697 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:01.512596 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 19:02:01.513658 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:01.513634 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cdphm" Jul 08 19:02:01.953631 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:01.953548 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:01.954078 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:01.953659 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:01.954078 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:01.953717 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:01.954078 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:01.953829 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:02.953076 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:02.953044 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:02.953328 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:02.953187 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:03.952595 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:03.952556 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:03.953160 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:03.952696 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:03.953160 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:03.953083 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:03.953263 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:03.953173 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:04.953345 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:04.953312 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:04.953844 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:04.953475 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:05.953334 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:05.953279 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:05.953547 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:05.953337 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:05.953547 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:05.953451 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:05.953875 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:05.953571 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:06.952600 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:06.952561 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:06.952802 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:06.952710 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:07.953483 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:07.953447 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:07.953483 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:07.953494 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:07.953903 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:07.953586 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:07.953903 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:07.953694 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:08.953422 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:08.953143 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:08.953578 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:08.953552 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:09.064797 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.064704 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" event={"ID":"9c970e29-f821-46b8-ad53-970a11060b2b","Type":"ContainerStarted","Data":"30777572d3d5917aa463c43a6f5a5c2d8706f0efe7dd6a89207db47c73b8c0da"} Jul 08 19:02:09.067560 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.067528 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"d35b51f01e0a59b3fa01087b92cf2391c643037fbb09c5fc4cd9db95266cd6b3"} Jul 08 19:02:09.067721 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.067596 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"00db1b2519bd75036502988390b2a287c3b0b52f2f5edc03c130879cfaf25738"} Jul 08 19:02:09.067721 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.067637 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"570e4645f4ec40f4dc3fb4a384883030d3d2ccbbe0fb4a425826a05ed41010c9"} Jul 08 19:02:09.067721 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.067666 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"cf6964dec36750d7d46ebf8c9cefdfc8d2bebd1b773a71918fd26f2392f03308"} Jul 08 19:02:09.067721 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.067696 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"d1a7d392430fae0a29ceced9d300a15491b6062314eef2bc7b41dddecd1f68c9"} Jul 08 19:02:09.067925 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.067731 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"b825e357a5bef8555d6d8dfe3ebb9c80d7568aeb3201e1ee2f951e02e89127c3"} Jul 08 19:02:09.069548 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.069519 2560 generic.go:356] "Generic (PLEG): container finished" podID="8d1ed88f-1103-4016-8544-4729840f472d" containerID="0b7aa610e2dfd266aacba3632ff80bf68607ceac75e4c00c9915a7e3c4adc4c9" exitCode=0 Jul 08 19:02:09.069653 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.069599 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" event={"ID":"8d1ed88f-1103-4016-8544-4729840f472d","Type":"ContainerDied","Data":"0b7aa610e2dfd266aacba3632ff80bf68607ceac75e4c00c9915a7e3c4adc4c9"} Jul 08 19:02:09.071336 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.071312 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4ffqm" event={"ID":"6c13a6c5-5b12-4118-9122-74c8b9ecd5b9","Type":"ContainerStarted","Data":"10c1c7dee3bc2cfad188b847d6489b8efd63dc081ceb5c18d5fad7e7defb2e77"} Jul 08 19:02:09.083173 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.083117 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2xhvw" podStartSLOduration=7.139172382 podStartE2EDuration="27.083102101s" totalImagesPullingTime="19.943929719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:09.082753573 +0000 UTC m=+27.773745095" watchObservedRunningTime="2026-07-08 19:02:09.083102101 +0000 UTC m=+27.774093623" Jul 08 19:02:09.099827 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.099773 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4ffqm" podStartSLOduration=2.900655607 podStartE2EDuration="27.09974778s" totalImagesPullingTime="24.199092173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:09.09886823 +0000 UTC m=+27.789859752" watchObservedRunningTime="2026-07-08 19:02:09.09974778 +0000 UTC m=+27.790739301" Jul 08 19:02:09.953056 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.953017 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:09.953315 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:09.953017 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:09.953315 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:09.953133 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:09.953315 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:09.953207 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:10.952847 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:10.952817 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:10.953449 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:10.952921 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:11.080561 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:11.080531 2560 generic.go:356] "Generic (PLEG): container finished" podID="8d1ed88f-1103-4016-8544-4729840f472d" containerID="e44490d2732a68045ecc012ea99cc936f677681c188723d89c9ee6ec59ef12bf" exitCode=0 Jul 08 19:02:11.080707 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:11.080597 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" event={"ID":"8d1ed88f-1103-4016-8544-4729840f472d","Type":"ContainerDied","Data":"e44490d2732a68045ecc012ea99cc936f677681c188723d89c9ee6ec59ef12bf"} Jul 08 19:02:11.953428 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:11.953373 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:11.954025 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:11.953500 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:11.954025 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:11.953547 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:11.954025 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:11.953663 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:12.086233 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:12.086201 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"6d7987e4a941ea31a47d6fc3487893a84e24b64e3914c31bc74f3db9d95b99fb"} Jul 08 19:02:12.953185 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:12.953143 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:12.953362 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:12.953259 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:13.090247 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:13.090207 2560 generic.go:356] "Generic (PLEG): container finished" podID="8d1ed88f-1103-4016-8544-4729840f472d" containerID="1063549f3537fb9df35873a7a558d40a12c60d0026609375f5d97cadc415a093" exitCode=0 Jul 08 19:02:13.090641 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:13.090259 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" event={"ID":"8d1ed88f-1103-4016-8544-4729840f472d","Type":"ContainerDied","Data":"1063549f3537fb9df35873a7a558d40a12c60d0026609375f5d97cadc415a093"} Jul 08 19:02:13.953152 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:13.952936 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:13.953411 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:13.952975 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:13.953411 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:13.953253 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:13.953411 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:13.953330 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:14.097403 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:14.097344 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" event={"ID":"db0ea9b0-74a0-4e2d-9bf4-f7cac85278a4","Type":"ContainerStarted","Data":"04b130d5672c48cce8026cb04daf7e2dd460f6f7bec5ec273440f4e78d4cbb42"} Jul 08 19:02:14.097848 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:14.097670 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:02:14.097848 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:14.097742 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:02:14.117052 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:14.117013 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:02:14.165983 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:14.165927 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" podStartSLOduration=7.88941313 podStartE2EDuration="32.165909591s" totalImagesPullingTime="24.276496461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:14.13556064 +0000 UTC m=+32.826552162" watchObservedRunningTime="2026-07-08 19:02:14.165909591 +0000 UTC m=+32.856901113" Jul 08 19:02:14.952719 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:14.952681 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:14.952890 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:14.952796 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:15.102364 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.101078 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:02:15.120166 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.120134 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:02:15.490553 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.490516 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:15.490748 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.490573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:15.490748 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.490692 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 19:02:15.490748 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.490711 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 19:02:15.490748 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.490734 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 19:02:15.490748 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.490747 2560 projected.go:196] Error preparing data for projected volume kube-api-access-kkb76 for pod openshift-network-diagnostics/network-check-target-2slmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:02:15.490983 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.490760 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret podName:4cc34c95-fd99-488a-9325-4056ffe2c48a nodeName:}" failed. No retries permitted until 2026-07-08 19:02:47.490741812 +0000 UTC m=+66.181733318 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret") pod "global-pull-secret-syncer-2h4tw" (UID: "4cc34c95-fd99-488a-9325-4056ffe2c48a") : object "kube-system"/"original-pull-secret" not registered Jul 08 19:02:15.490983 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.490797 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76 podName:9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:47.490783873 +0000 UTC m=+66.181775388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kkb76" (UniqueName: "kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76") pod "network-check-target-2slmq" (UID: "9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 19:02:15.559798 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.559759 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2slmq"] Jul 08 19:02:15.560021 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.559914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:15.560021 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.559999 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:15.561918 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.561890 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vk797"] Jul 08 19:02:15.562062 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.562011 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:15.562126 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.562106 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:15.575695 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.575659 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2h4tw"] Jul 08 19:02:15.575905 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.575785 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:15.575905 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.575868 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:15.591295 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:15.591143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:15.591519 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.591298 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:02:15.591519 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:15.591362 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs podName:eb492e2e-7cb5-43e7-b25e-4507b7fa2d28 nodeName:}" failed. No retries permitted until 2026-07-08 19:02:47.591342749 +0000 UTC m=+66.282334264 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs") pod "network-metrics-daemon-vk797" (UID: "eb492e2e-7cb5-43e7-b25e-4507b7fa2d28") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 19:02:16.953421 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:16.953371 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:16.953971 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:16.953430 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:16.953971 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:16.953430 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:16.953971 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:16.953525 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:16.953971 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:16.953610 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:16.953971 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:16.953668 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:18.953428 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:18.953135 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:18.953428 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:18.953165 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:18.953818 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:18.953459 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:18.953818 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:18.953195 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:18.953818 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:18.953503 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:18.953818 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:18.953592 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:19.112663 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:19.112624 2560 generic.go:356] "Generic (PLEG): container finished" podID="8d1ed88f-1103-4016-8544-4729840f472d" containerID="80be4c458a2027fb6757be1c7f5f4f4db9d37da0de8f8d3c260587501535f907" exitCode=0 Jul 08 19:02:19.112824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:19.112673 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" event={"ID":"8d1ed88f-1103-4016-8544-4729840f472d","Type":"ContainerDied","Data":"80be4c458a2027fb6757be1c7f5f4f4db9d37da0de8f8d3c260587501535f907"} Jul 08 19:02:20.117719 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:20.117683 2560 generic.go:356] "Generic (PLEG): container finished" podID="8d1ed88f-1103-4016-8544-4729840f472d" containerID="f33c51a086c2749f37cd7831fbc4cdcda59cf362040a42380f9638839cf9e78a" exitCode=0 Jul 08 19:02:20.118434 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:20.117734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" event={"ID":"8d1ed88f-1103-4016-8544-4729840f472d","Type":"ContainerDied","Data":"f33c51a086c2749f37cd7831fbc4cdcda59cf362040a42380f9638839cf9e78a"} Jul 08 19:02:20.952511 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:20.952469 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:20.952682 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:20.952474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:20.952682 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:20.952577 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2h4tw" podUID="4cc34c95-fd99-488a-9325-4056ffe2c48a" Jul 08 19:02:20.952682 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:20.952474 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:20.952682 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:20.952663 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vk797" podUID="eb492e2e-7cb5-43e7-b25e-4507b7fa2d28" Jul 08 19:02:20.952808 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:20.952719 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2slmq" podUID="9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7" Jul 08 19:02:21.120513 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.120430 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-210.ec2.internal" event="NodeReady" Jul 08 19:02:21.120933 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.120586 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 19:02:21.124511 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.124469 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" event={"ID":"8d1ed88f-1103-4016-8544-4729840f472d","Type":"ContainerStarted","Data":"88e755b7ab2ac08515e9e4326aae543661e0bc971d3c762714cd020300185e18"} Jul 08 19:02:21.159173 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.159121 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xm2ds" podStartSLOduration=7.87418345 podStartE2EDuration="39.1591016s" totalImagesPullingTime="31.28491815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:21.158920233 +0000 UTC m=+39.849911768" watchObservedRunningTime="2026-07-08 19:02:21.1591016 +0000 UTC m=+39.850093122" Jul 08 19:02:21.227266 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.227228 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sjvht"] Jul 08 19:02:21.247605 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.247569 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cgb25"] Jul 08 19:02:21.247776 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.247692 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.259620 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.259593 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 19:02:21.260051 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.260023 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 19:02:21.260171 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.260103 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgfwc\"" Jul 08 19:02:21.271631 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.271595 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h6nzw"] Jul 08 19:02:21.271772 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.271735 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cgb25" Jul 08 19:02:21.274444 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.274413 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 19:02:21.274626 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.274592 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hl22b\"" Jul 08 19:02:21.274769 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.274748 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 19:02:21.275347 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.275331 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 19:02:21.291611 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.291584 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cgb25"] Jul 08 19:02:21.291611 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.291618 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sjvht"] Jul 08 19:02:21.291819 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.291638 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6nzw"] Jul 08 19:02:21.291819 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.291734 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.301334 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.301314 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 19:02:21.304604 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.304579 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bk24w\"" Jul 08 19:02:21.304743 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.304640 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 19:02:21.304890 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.304872 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 19:02:21.307867 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.307846 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 19:02:21.336153 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.336122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77cee5da-d849-4446-9a64-4608cb395353-metrics-tls\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.336436 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.336246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77cee5da-d849-4446-9a64-4608cb395353-config-volume\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.336436 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.336274 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7d2c\" (UniqueName: \"kubernetes.io/projected/77cee5da-d849-4446-9a64-4608cb395353-kube-api-access-j7d2c\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.336436 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.336337 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77cee5da-d849-4446-9a64-4608cb395353-tmp-dir\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.437534 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437433 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77cee5da-d849-4446-9a64-4608cb395353-config-volume\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.437534 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437470 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7d2c\" (UniqueName: \"kubernetes.io/projected/77cee5da-d849-4446-9a64-4608cb395353-kube-api-access-j7d2c\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.437534 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437495 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896ba504-79d4-4baf-8537-dde513642ece-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.437824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af9a6bc-b84e-46e6-8a0c-414913508676-cert\") pod \"ingress-canary-cgb25\" (UID: \"7af9a6bc-b84e-46e6-8a0c-414913508676\") " pod="openshift-ingress-canary/ingress-canary-cgb25" Jul 08 19:02:21.437824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896ba504-79d4-4baf-8537-dde513642ece-data-volume\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.437824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437715 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77cee5da-d849-4446-9a64-4608cb395353-tmp-dir\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.437824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnnd4\" (UniqueName: \"kubernetes.io/projected/896ba504-79d4-4baf-8537-dde513642ece-kube-api-access-cnnd4\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.437824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437762 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896ba504-79d4-4baf-8537-dde513642ece-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.437824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437822 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77cee5da-d849-4446-9a64-4608cb395353-metrics-tls\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.438105 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437852 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896ba504-79d4-4baf-8537-dde513642ece-crio-socket\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.438105 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.437899 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxtkz\" (UniqueName: \"kubernetes.io/projected/7af9a6bc-b84e-46e6-8a0c-414913508676-kube-api-access-xxtkz\") pod \"ingress-canary-cgb25\" (UID: \"7af9a6bc-b84e-46e6-8a0c-414913508676\") " pod="openshift-ingress-canary/ingress-canary-cgb25" Jul 08 19:02:21.438105 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.438045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77cee5da-d849-4446-9a64-4608cb395353-tmp-dir\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.442346 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.442324 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77cee5da-d849-4446-9a64-4608cb395353-metrics-tls\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.449526 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.449501 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77cee5da-d849-4446-9a64-4608cb395353-config-volume\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.451542 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.451521 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7d2c\" (UniqueName: \"kubernetes.io/projected/77cee5da-d849-4446-9a64-4608cb395353-kube-api-access-j7d2c\") pod \"dns-default-sjvht\" (UID: \"77cee5da-d849-4446-9a64-4608cb395353\") " pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.538664 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.538629 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896ba504-79d4-4baf-8537-dde513642ece-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.538664 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.538664 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af9a6bc-b84e-46e6-8a0c-414913508676-cert\") pod \"ingress-canary-cgb25\" (UID: \"7af9a6bc-b84e-46e6-8a0c-414913508676\") " pod="openshift-ingress-canary/ingress-canary-cgb25" Jul 08 19:02:21.538664 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.538685 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896ba504-79d4-4baf-8537-dde513642ece-data-volume\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.538975 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.538709 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnnd4\" (UniqueName: \"kubernetes.io/projected/896ba504-79d4-4baf-8537-dde513642ece-kube-api-access-cnnd4\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.538975 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.538727 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896ba504-79d4-4baf-8537-dde513642ece-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.538975 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.538752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896ba504-79d4-4baf-8537-dde513642ece-crio-socket\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.538975 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.538895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxtkz\" (UniqueName: \"kubernetes.io/projected/7af9a6bc-b84e-46e6-8a0c-414913508676-kube-api-access-xxtkz\") pod \"ingress-canary-cgb25\" (UID: \"7af9a6bc-b84e-46e6-8a0c-414913508676\") " pod="openshift-ingress-canary/ingress-canary-cgb25" Jul 08 19:02:21.538975 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.538972 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/896ba504-79d4-4baf-8537-dde513642ece-crio-socket\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.539253 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.539143 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/896ba504-79d4-4baf-8537-dde513642ece-data-volume\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.539352 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.539329 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/896ba504-79d4-4baf-8537-dde513642ece-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.541198 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.541176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/896ba504-79d4-4baf-8537-dde513642ece-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.541297 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.541265 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7af9a6bc-b84e-46e6-8a0c-414913508676-cert\") pod \"ingress-canary-cgb25\" (UID: \"7af9a6bc-b84e-46e6-8a0c-414913508676\") " pod="openshift-ingress-canary/ingress-canary-cgb25" Jul 08 19:02:21.551157 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.551131 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnnd4\" (UniqueName: \"kubernetes.io/projected/896ba504-79d4-4baf-8537-dde513642ece-kube-api-access-cnnd4\") pod \"insights-runtime-extractor-h6nzw\" (UID: \"896ba504-79d4-4baf-8537-dde513642ece\") " pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.551309 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.551233 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxtkz\" (UniqueName: \"kubernetes.io/projected/7af9a6bc-b84e-46e6-8a0c-414913508676-kube-api-access-xxtkz\") pod \"ingress-canary-cgb25\" (UID: \"7af9a6bc-b84e-46e6-8a0c-414913508676\") " pod="openshift-ingress-canary/ingress-canary-cgb25" Jul 08 19:02:21.557085 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.557060 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:21.580888 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.580863 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cgb25" Jul 08 19:02:21.599968 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.599929 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h6nzw" Jul 08 19:02:21.772024 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.771822 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cgb25"] Jul 08 19:02:21.776344 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.776319 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sjvht"] Jul 08 19:02:21.776344 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:21.776328 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af9a6bc_b84e_46e6_8a0c_414913508676.slice/crio-d89cd46a736df0e0e4dfd14259fc1148bea18d6ebd93f3a5cbef76d219cf761e WatchSource:0}: Error finding container d89cd46a736df0e0e4dfd14259fc1148bea18d6ebd93f3a5cbef76d219cf761e: Status 404 returned error can't find the container with id d89cd46a736df0e0e4dfd14259fc1148bea18d6ebd93f3a5cbef76d219cf761e Jul 08 19:02:21.780069 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:21.780047 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77cee5da_d849_4446_9a64_4608cb395353.slice/crio-283123634b33d9bc63580632e085cefcebb5628eb6fc6814525ef96bda889920 WatchSource:0}: Error finding container 283123634b33d9bc63580632e085cefcebb5628eb6fc6814525ef96bda889920: Status 404 returned error can't find the container with id 283123634b33d9bc63580632e085cefcebb5628eb6fc6814525ef96bda889920 Jul 08 19:02:21.797285 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:21.797255 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h6nzw"] Jul 08 19:02:21.801365 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:21.801339 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896ba504_79d4_4baf_8537_dde513642ece.slice/crio-920f03a41e22e358c43ae0620f2aa135186a172114dbcec493f641e8269c4ab8 WatchSource:0}: Error finding container 920f03a41e22e358c43ae0620f2aa135186a172114dbcec493f641e8269c4ab8: Status 404 returned error can't find the container with id 920f03a41e22e358c43ae0620f2aa135186a172114dbcec493f641e8269c4ab8 Jul 08 19:02:22.127444 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.127407 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cgb25" event={"ID":"7af9a6bc-b84e-46e6-8a0c-414913508676","Type":"ContainerStarted","Data":"d89cd46a736df0e0e4dfd14259fc1148bea18d6ebd93f3a5cbef76d219cf761e"} Jul 08 19:02:22.128510 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.128482 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6nzw" event={"ID":"896ba504-79d4-4baf-8537-dde513642ece","Type":"ContainerStarted","Data":"920f03a41e22e358c43ae0620f2aa135186a172114dbcec493f641e8269c4ab8"} Jul 08 19:02:22.129544 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.129523 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjvht" event={"ID":"77cee5da-d849-4446-9a64-4608cb395353","Type":"ContainerStarted","Data":"283123634b33d9bc63580632e085cefcebb5628eb6fc6814525ef96bda889920"} Jul 08 19:02:22.953133 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.953085 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:22.953896 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.953504 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:22.953896 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.953772 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:22.960274 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.960247 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:02:22.960571 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.960552 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:02:22.960816 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.960799 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:02:22.960923 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.960902 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-72lbb\"" Jul 08 19:02:22.961043 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.961026 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-db4b9\"" Jul 08 19:02:22.961132 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:22.961113 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:02:24.064906 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.064869 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6775f7d584-s7ndl"] Jul 08 19:02:24.145716 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.145660 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6775f7d584-s7ndl"] Jul 08 19:02:24.145894 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.145787 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.149606 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.149579 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 19:02:24.149837 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.149817 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6m9lb\"" Jul 08 19:02:24.151634 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.151575 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 19:02:24.151634 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.151580 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 19:02:24.160680 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.160647 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 19:02:24.160680 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.160647 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 19:02:24.160862 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.160739 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 19:02:24.161244 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.161022 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 19:02:24.173301 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.173268 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 19:02:24.260098 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.260062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-trusted-ca-bundle\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.260292 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.260108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-oauth-config\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.260292 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.260140 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-serving-cert\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.260292 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.260180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-service-ca\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.260292 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.260206 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-oauth-serving-cert\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.260292 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.260234 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsbdz\" (UniqueName: \"kubernetes.io/projected/207335dc-c0c4-4ece-bf0c-c5c27830b85c-kube-api-access-vsbdz\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.260531 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.260294 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-config\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.361097 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.361005 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-trusted-ca-bundle\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.361097 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.361065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-oauth-config\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.361323 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.361240 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-serving-cert\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.361415 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.361337 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-service-ca\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.361415 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.361368 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-oauth-serving-cert\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.361518 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.361422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsbdz\" (UniqueName: \"kubernetes.io/projected/207335dc-c0c4-4ece-bf0c-c5c27830b85c-kube-api-access-vsbdz\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.361518 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.361479 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-config\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.362351 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.362072 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-trusted-ca-bundle\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.362351 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.362249 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-config\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.362351 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.362307 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-oauth-serving-cert\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.362684 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.362667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-service-ca\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.365758 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.365735 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-oauth-config\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.365874 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.365846 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-serving-cert\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.371460 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.371434 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsbdz\" (UniqueName: \"kubernetes.io/projected/207335dc-c0c4-4ece-bf0c-c5c27830b85c-kube-api-access-vsbdz\") pod \"console-6775f7d584-s7ndl\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:24.457911 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:24.457866 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:27.987994 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:27.987792 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6775f7d584-s7ndl"] Jul 08 19:02:28.004301 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:28.004266 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207335dc_c0c4_4ece_bf0c_c5c27830b85c.slice/crio-dd076831ec7308b8b23088c8e18147977bc8a81fc53fa9ff5b1907ef63edc127 WatchSource:0}: Error finding container dd076831ec7308b8b23088c8e18147977bc8a81fc53fa9ff5b1907ef63edc127: Status 404 returned error can't find the container with id dd076831ec7308b8b23088c8e18147977bc8a81fc53fa9ff5b1907ef63edc127 Jul 08 19:02:28.148459 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:28.148212 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cgb25" event={"ID":"7af9a6bc-b84e-46e6-8a0c-414913508676","Type":"ContainerStarted","Data":"3173eaa7915a5d58d633799aadac4d6faa1bb7dbe661f3efd353ee494701b29d"} Jul 08 19:02:28.149846 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:28.149813 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6775f7d584-s7ndl" event={"ID":"207335dc-c0c4-4ece-bf0c-c5c27830b85c","Type":"ContainerStarted","Data":"dd076831ec7308b8b23088c8e18147977bc8a81fc53fa9ff5b1907ef63edc127"} Jul 08 19:02:28.151979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:28.151946 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6nzw" event={"ID":"896ba504-79d4-4baf-8537-dde513642ece","Type":"ContainerStarted","Data":"dd8f76da92bf79d599d232ab8c8817c5d9f609529b6aed07a4e3e95f5de620b4"} Jul 08 19:02:28.155056 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:28.155024 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjvht" event={"ID":"77cee5da-d849-4446-9a64-4608cb395353","Type":"ContainerStarted","Data":"b3832fca7aa87d6dd583ecd19decdacb643ca8af39e39932724d0e4a6230d606"} Jul 08 19:02:28.155181 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:28.155077 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sjvht" event={"ID":"77cee5da-d849-4446-9a64-4608cb395353","Type":"ContainerStarted","Data":"2b63497816c34d6c9e6b3e30067a7cb77c94f7c006c27578ac37c6ec97b63695"} Jul 08 19:02:28.155254 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:28.155197 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:28.193980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:28.193920 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cgb25" podStartSLOduration=1.15510423 podStartE2EDuration="7.19390216s" totalImagesPullingTime="6.03879793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:28.18608911 +0000 UTC m=+46.877080632" watchObservedRunningTime="2026-07-08 19:02:28.19390216 +0000 UTC m=+46.884893661" Jul 08 19:02:28.242860 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:28.242799 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sjvht" podStartSLOduration=1.207156794 podStartE2EDuration="7.242778538s" totalImagesPullingTime="6.035621744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:28.241813348 +0000 UTC m=+46.932804870" watchObservedRunningTime="2026-07-08 19:02:28.242778538 +0000 UTC m=+46.933770063" Jul 08 19:02:30.162689 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:30.162640 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6nzw" event={"ID":"896ba504-79d4-4baf-8537-dde513642ece","Type":"ContainerStarted","Data":"d530f731b96752843a1a2c0350d5107a49f8f154da3c55ff93d90514e44bf284"} Jul 08 19:02:31.621477 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.621437 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6"] Jul 08 19:02:31.650429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.650396 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.653739 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.653713 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6"] Jul 08 19:02:31.655582 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.654454 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-97bch\"" Jul 08 19:02:31.655582 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.654458 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 19:02:31.655582 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.654503 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 19:02:31.663335 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.661066 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 19:02:31.663335 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.661525 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 19:02:31.663335 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.661889 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 19:02:31.671734 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.671688 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl"] Jul 08 19:02:31.682982 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.682953 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.695194 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.695164 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 19:02:31.695356 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.695216 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 19:02:31.695356 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.695237 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 19:02:31.695682 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.695662 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7nfpg\"" Jul 08 19:02:31.700120 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.700092 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t9xfr"] Jul 08 19:02:31.711290 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.711252 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl"] Jul 08 19:02:31.711519 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.711410 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.720501 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.720466 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hngkx\"" Jul 08 19:02:31.720882 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.720856 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 19:02:31.721367 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d2a5366-28df-4ebf-95b1-09ae454185b5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.721488 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721371 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.721488 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.721488 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d2a5366-28df-4ebf-95b1-09ae454185b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.721593 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721516 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9srf4\" (UniqueName: \"kubernetes.io/projected/4d2a5366-28df-4ebf-95b1-09ae454185b5-kube-api-access-9srf4\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.721593 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-tls\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.721656 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.721691 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721653 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-wtmp\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.721723 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d2a5366-28df-4ebf-95b1-09ae454185b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.721771 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721727 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrgnx\" (UniqueName: \"kubernetes.io/projected/e98bd1f1-7515-419e-8625-ea1499f4195b-kube-api-access-wrgnx\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.721771 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721755 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/623f6cba-b644-4fc5-8163-07feed641333-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.721966 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-textfile\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.721966 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721829 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-root\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.721966 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/623f6cba-b644-4fc5-8163-07feed641333-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.721966 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721881 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-sys\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.721966 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721957 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.722175 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.721989 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.722175 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.722019 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e98bd1f1-7515-419e-8625-ea1499f4195b-metrics-client-ca\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.722175 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.722082 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dr8g\" (UniqueName: \"kubernetes.io/projected/623f6cba-b644-4fc5-8163-07feed641333-kube-api-access-4dr8g\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.722175 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.722165 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 19:02:31.722483 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.722463 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 19:02:31.823233 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9srf4\" (UniqueName: \"kubernetes.io/projected/4d2a5366-28df-4ebf-95b1-09ae454185b5-kube-api-access-9srf4\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.823233 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-tls\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823522 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823291 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.823522 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-wtmp\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823522 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d2a5366-28df-4ebf-95b1-09ae454185b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.823522 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823417 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrgnx\" (UniqueName: \"kubernetes.io/projected/e98bd1f1-7515-419e-8625-ea1499f4195b-kube-api-access-wrgnx\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823522 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:31.823424 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 19:02:31.823522 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823443 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/623f6cba-b644-4fc5-8163-07feed641333-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.823522 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-textfile\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823522 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:02:31.823494 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-tls podName:e98bd1f1-7515-419e-8625-ea1499f4195b nodeName:}" failed. No retries permitted until 2026-07-08 19:02:32.323474286 +0000 UTC m=+51.014465805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-tls") pod "node-exporter-t9xfr" (UID: "e98bd1f1-7515-419e-8625-ea1499f4195b") : secret "node-exporter-tls" not found Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-root\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823538 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-wtmp\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823559 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/623f6cba-b644-4fc5-8163-07feed641333-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-sys\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823650 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823671 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e98bd1f1-7515-419e-8625-ea1499f4195b-metrics-client-ca\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823728 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dr8g\" (UniqueName: \"kubernetes.io/projected/623f6cba-b644-4fc5-8163-07feed641333-kube-api-access-4dr8g\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823751 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d2a5366-28df-4ebf-95b1-09ae454185b5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823777 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823794 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-textfile\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823804 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.823928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.823906 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d2a5366-28df-4ebf-95b1-09ae454185b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.824922 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.824485 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/623f6cba-b644-4fc5-8163-07feed641333-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.824922 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.824517 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-root\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.824922 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.824778 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/623f6cba-b644-4fc5-8163-07feed641333-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.825051 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.824948 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e98bd1f1-7515-419e-8625-ea1499f4195b-metrics-client-ca\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.825320 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.825236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d2a5366-28df-4ebf-95b1-09ae454185b5-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.825645 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.825611 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e98bd1f1-7515-419e-8625-ea1499f4195b-sys\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.826299 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.826232 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.829209 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.829164 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d2a5366-28df-4ebf-95b1-09ae454185b5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.829636 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.829592 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.830235 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.830210 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.830418 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.830340 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.830418 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.831318 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d2a5366-28df-4ebf-95b1-09ae454185b5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.836496 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.836468 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrgnx\" (UniqueName: \"kubernetes.io/projected/e98bd1f1-7515-419e-8625-ea1499f4195b-kube-api-access-wrgnx\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:31.836656 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.836634 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9srf4\" (UniqueName: \"kubernetes.io/projected/4d2a5366-28df-4ebf-95b1-09ae454185b5-kube-api-access-9srf4\") pod \"openshift-state-metrics-54cf96dfcf-j5lk6\" (UID: \"4d2a5366-28df-4ebf-95b1-09ae454185b5\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.837119 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.837094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dr8g\" (UniqueName: \"kubernetes.io/projected/623f6cba-b644-4fc5-8163-07feed641333-kube-api-access-4dr8g\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.843956 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.843933 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/623f6cba-b644-4fc5-8163-07feed641333-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-bc2sl\" (UID: \"623f6cba-b644-4fc5-8163-07feed641333\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:31.965222 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.965192 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" Jul 08 19:02:31.994453 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:31.994241 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" Jul 08 19:02:32.327837 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.327752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-tls\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:32.330241 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.330212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e98bd1f1-7515-419e-8625-ea1499f4195b-node-exporter-tls\") pod \"node-exporter-t9xfr\" (UID: \"e98bd1f1-7515-419e-8625-ea1499f4195b\") " pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:32.625717 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.625622 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9xfr" Jul 08 19:02:32.826091 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.826048 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:02:32.839686 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.839648 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.845521 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.845485 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 19:02:32.845844 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.845827 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 19:02:32.845919 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.845907 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 19:02:32.846008 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.845827 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 19:02:32.846194 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.846178 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 19:02:32.846281 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.846267 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 19:02:32.846498 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.846452 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 19:02:32.846629 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.846542 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 19:02:32.848081 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.847013 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 19:02:32.853718 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.853691 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-z2t7z\"" Jul 08 19:02:32.854451 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.854427 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:02:32.934637 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934550 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-config-volume\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.934637 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934589 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-config-out\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.934637 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.934888 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.934888 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934754 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.934888 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934796 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.934888 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934838 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2z8v\" (UniqueName: \"kubernetes.io/projected/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-kube-api-access-c2z8v\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.934888 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.935114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934899 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.935114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934916 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-web-config\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.935114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.935114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.934953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:32.935114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:32.935031 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.035464 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.035422 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-config-volume\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.035464 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.035470 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-config-out\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.035824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.035780 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.035952 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.035829 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.035952 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.035864 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.035952 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.035895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.035952 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.035948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2z8v\" (UniqueName: \"kubernetes.io/projected/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-kube-api-access-c2z8v\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.036160 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.035981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.036160 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.036008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.036160 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.036032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-web-config\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.036160 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.036056 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.036160 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.036083 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.036483 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.036187 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.036483 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.036225 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.037034 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.037004 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.038264 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.038099 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.038969 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.038924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-config-volume\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.039743 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.039718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-config-out\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.040166 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.040141 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-tls-assets\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.040456 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.040413 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.041720 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.041656 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.041908 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.041884 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.041987 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.041897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.042241 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.042135 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-web-config\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.042705 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.042684 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.058467 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.058438 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2z8v\" (UniqueName: \"kubernetes.io/projected/34e56622-4c7b-4686-b4bf-f9bfcbd11e96-kube-api-access-c2z8v\") pod \"alertmanager-main-0\" (UID: \"34e56622-4c7b-4686-b4bf-f9bfcbd11e96\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:33.160244 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:33.160204 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 19:02:34.017968 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.017930 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 19:02:34.022015 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:34.021988 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e56622_4c7b_4686_b4bf_f9bfcbd11e96.slice/crio-78138a0035d2e7a5174a9d293a57f0321fff876c2b0d67174f98b77e0b8b2666 WatchSource:0}: Error finding container 78138a0035d2e7a5174a9d293a57f0321fff876c2b0d67174f98b77e0b8b2666: Status 404 returned error can't find the container with id 78138a0035d2e7a5174a9d293a57f0321fff876c2b0d67174f98b77e0b8b2666 Jul 08 19:02:34.178074 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.177978 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e56622-4c7b-4686-b4bf-f9bfcbd11e96","Type":"ContainerStarted","Data":"78138a0035d2e7a5174a9d293a57f0321fff876c2b0d67174f98b77e0b8b2666"} Jul 08 19:02:34.179571 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.179532 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6775f7d584-s7ndl" event={"ID":"207335dc-c0c4-4ece-bf0c-c5c27830b85c","Type":"ContainerStarted","Data":"e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5"} Jul 08 19:02:34.181349 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.181325 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h6nzw" event={"ID":"896ba504-79d4-4baf-8537-dde513642ece","Type":"ContainerStarted","Data":"a0d8a7c4bd64fdf267d6ab5dfebb1ff4fefd69ff9aa02ff3e37e387e68b7ba7a"} Jul 08 19:02:34.182346 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.182325 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9xfr" event={"ID":"e98bd1f1-7515-419e-8625-ea1499f4195b","Type":"ContainerStarted","Data":"57e3bdfad857c975134b2d2e2725bf000edbf97b8d60206d9cb6a1a6bd73a517"} Jul 08 19:02:34.203834 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.203784 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6775f7d584-s7ndl" podStartSLOduration=4.360916406 podStartE2EDuration="10.203762504s" totalImagesPullingTime="5.842846098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:34.203256067 +0000 UTC m=+52.894247589" watchObservedRunningTime="2026-07-08 19:02:34.203762504 +0000 UTC m=+52.894754077" Jul 08 19:02:34.235370 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.235326 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl"] Jul 08 19:02:34.235938 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.235890 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h6nzw" podStartSLOduration=1.410185251 podStartE2EDuration="13.235873828s" totalImagesPullingTime="11.825688577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:02:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:34.23286794 +0000 UTC m=+52.923859489" watchObservedRunningTime="2026-07-08 19:02:34.235873828 +0000 UTC m=+52.926865346" Jul 08 19:02:34.237501 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.237477 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6"] Jul 08 19:02:34.238518 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:34.238492 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623f6cba_b644_4fc5_8163_07feed641333.slice/crio-89a3575d09d8f6e16d6c8dd35b9477360e5fe7669d8baf2aed5f8c56670a4415 WatchSource:0}: Error finding container 89a3575d09d8f6e16d6c8dd35b9477360e5fe7669d8baf2aed5f8c56670a4415: Status 404 returned error can't find the container with id 89a3575d09d8f6e16d6c8dd35b9477360e5fe7669d8baf2aed5f8c56670a4415 Jul 08 19:02:34.241524 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:34.241499 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2a5366_28df_4ebf_95b1_09ae454185b5.slice/crio-fd2eb6a69aeffd3d8b88e205181162f94fc13fc3151b2c7d85cafc382d2c3e59 WatchSource:0}: Error finding container fd2eb6a69aeffd3d8b88e205181162f94fc13fc3151b2c7d85cafc382d2c3e59: Status 404 returned error can't find the container with id fd2eb6a69aeffd3d8b88e205181162f94fc13fc3151b2c7d85cafc382d2c3e59 Jul 08 19:02:34.458741 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.458707 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:34.458888 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.458831 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:34.466276 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:34.466243 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:35.187580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.187540 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" event={"ID":"4d2a5366-28df-4ebf-95b1-09ae454185b5","Type":"ContainerStarted","Data":"fdfe6fef5d9b75127f2ed76caa491dfc30e043345262789c0ba6414e60256415"} Jul 08 19:02:35.188005 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.187606 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" event={"ID":"4d2a5366-28df-4ebf-95b1-09ae454185b5","Type":"ContainerStarted","Data":"21f5ebbf9dcd38767289730ebe2e72f09e9fd35f9f2c1bbdb60a9a30a3f9bdd9"} Jul 08 19:02:35.188005 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.187628 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" event={"ID":"4d2a5366-28df-4ebf-95b1-09ae454185b5","Type":"ContainerStarted","Data":"fd2eb6a69aeffd3d8b88e205181162f94fc13fc3151b2c7d85cafc382d2c3e59"} Jul 08 19:02:35.188699 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.188672 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" event={"ID":"623f6cba-b644-4fc5-8163-07feed641333","Type":"ContainerStarted","Data":"89a3575d09d8f6e16d6c8dd35b9477360e5fe7669d8baf2aed5f8c56670a4415"} Jul 08 19:02:35.192793 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.192772 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:02:35.762422 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.762326 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-657666f54d-8wqvb"] Jul 08 19:02:35.773484 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.773456 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.777854 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.777815 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 19:02:35.778002 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.777930 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 19:02:35.778480 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.778462 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 19:02:35.778578 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.778489 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zwjnw\"" Jul 08 19:02:35.778578 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.778548 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 19:02:35.779941 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.779920 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 19:02:35.780195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.780181 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8c766811hhbrc\"" Jul 08 19:02:35.793264 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.793224 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-657666f54d-8wqvb"] Jul 08 19:02:35.864805 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.864761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dm8w\" (UniqueName: \"kubernetes.io/projected/5b85877b-3481-48b7-a104-9ca6373c3683-kube-api-access-7dm8w\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.865032 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.864824 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.865032 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.864916 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-grpc-tls\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.865032 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.864977 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.865183 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.865055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-tls\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.865183 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.865090 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.865183 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.865172 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.865307 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.865221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b85877b-3481-48b7-a104-9ca6373c3683-metrics-client-ca\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.966159 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.966130 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dm8w\" (UniqueName: \"kubernetes.io/projected/5b85877b-3481-48b7-a104-9ca6373c3683-kube-api-access-7dm8w\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.966362 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.966173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.966362 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.966212 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-grpc-tls\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.966362 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.966252 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.966362 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.966281 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-tls\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.966651 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.966428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.966651 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.966558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.966651 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.966589 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b85877b-3481-48b7-a104-9ca6373c3683-metrics-client-ca\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.967536 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.967508 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5b85877b-3481-48b7-a104-9ca6373c3683-metrics-client-ca\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.969324 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.969302 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.969531 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.969454 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-tls\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.969605 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.969583 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.969659 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.969619 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.969780 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.969743 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.969891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.969875 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5b85877b-3481-48b7-a104-9ca6373c3683-secret-grpc-tls\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:35.985787 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:35.985755 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dm8w\" (UniqueName: \"kubernetes.io/projected/5b85877b-3481-48b7-a104-9ca6373c3683-kube-api-access-7dm8w\") pod \"thanos-querier-657666f54d-8wqvb\" (UID: \"5b85877b-3481-48b7-a104-9ca6373c3683\") " pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:36.083976 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.083938 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:36.195321 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.195280 2560 generic.go:356] "Generic (PLEG): container finished" podID="e98bd1f1-7515-419e-8625-ea1499f4195b" containerID="8f8490bf3c272065185e95cb9d40a06d77bafd5eccbe684be1c16407b35b2d93" exitCode=0 Jul 08 19:02:36.195770 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.195373 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9xfr" event={"ID":"e98bd1f1-7515-419e-8625-ea1499f4195b","Type":"ContainerDied","Data":"8f8490bf3c272065185e95cb9d40a06d77bafd5eccbe684be1c16407b35b2d93"} Jul 08 19:02:36.466001 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.465239 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-657666f54d-8wqvb"] Jul 08 19:02:36.665307 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:36.665272 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b85877b_3481_48b7_a104_9ca6373c3683.slice/crio-5b88b7902e4fa18dc0cd97d5be6d44c1e7fab18651d24895f57a0cd5a0e009be WatchSource:0}: Error finding container 5b88b7902e4fa18dc0cd97d5be6d44c1e7fab18651d24895f57a0cd5a0e009be: Status 404 returned error can't find the container with id 5b88b7902e4fa18dc0cd97d5be6d44c1e7fab18651d24895f57a0cd5a0e009be Jul 08 19:02:36.859820 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.859785 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65cc96494-8h9nc"] Jul 08 19:02:36.862031 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.862011 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:36.864147 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.864119 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 19:02:36.864273 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.864165 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 19:02:36.864714 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.864693 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-nn6nj\"" Jul 08 19:02:36.865029 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.865010 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 19:02:36.865130 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.865030 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 19:02:36.865373 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.865355 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 19:02:36.881472 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.881444 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 19:02:36.903146 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.903113 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65cc96494-8h9nc"] Jul 08 19:02:36.979981 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.979949 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-secret-telemeter-client\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:36.980158 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.979994 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh7tm\" (UniqueName: \"kubernetes.io/projected/9e7eb729-1eaf-48f0-8099-8a85f81049b9-kube-api-access-hh7tm\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:36.980158 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.980034 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-metrics-client-ca\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:36.980158 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.980114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:36.980280 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.980176 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-federate-client-tls\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:36.980280 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.980210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:36.980280 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.980239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-telemeter-client-tls\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:36.980280 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:36.980277 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-serving-certs-ca-bundle\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.081089 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.081050 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-telemeter-client-tls\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.081089 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.081090 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-serving-certs-ca-bundle\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.081320 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.081112 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-secret-telemeter-client\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.081320 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.081152 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh7tm\" (UniqueName: \"kubernetes.io/projected/9e7eb729-1eaf-48f0-8099-8a85f81049b9-kube-api-access-hh7tm\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.081320 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.081181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-metrics-client-ca\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.081320 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.081210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.081320 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.081259 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-federate-client-tls\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.081625 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.081366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.082115 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.082044 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-metrics-client-ca\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.082249 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.082171 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-serving-certs-ca-bundle\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.082249 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.082218 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9e7eb729-1eaf-48f0-8099-8a85f81049b9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.083830 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.083808 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-telemeter-client-tls\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.083905 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.083870 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.084318 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.084301 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-federate-client-tls\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.084412 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.084333 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9e7eb729-1eaf-48f0-8099-8a85f81049b9-secret-telemeter-client\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.090196 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.090174 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh7tm\" (UniqueName: \"kubernetes.io/projected/9e7eb729-1eaf-48f0-8099-8a85f81049b9-kube-api-access-hh7tm\") pod \"telemeter-client-65cc96494-8h9nc\" (UID: \"9e7eb729-1eaf-48f0-8099-8a85f81049b9\") " pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.175551 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.175508 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" Jul 08 19:02:37.203579 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.203533 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" event={"ID":"4d2a5366-28df-4ebf-95b1-09ae454185b5","Type":"ContainerStarted","Data":"29e33e9228caa69c98bab24b5bef3aae93de835698ea0e746cbd484fa1313cd7"} Jul 08 19:02:37.205305 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.205280 2560 generic.go:356] "Generic (PLEG): container finished" podID="34e56622-4c7b-4686-b4bf-f9bfcbd11e96" containerID="5ee79f227d3c6283188f370f4e47c73005818a677bd09bf8993138557bd7cfea" exitCode=0 Jul 08 19:02:37.205467 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.205352 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e56622-4c7b-4686-b4bf-f9bfcbd11e96","Type":"ContainerDied","Data":"5ee79f227d3c6283188f370f4e47c73005818a677bd09bf8993138557bd7cfea"} Jul 08 19:02:37.207586 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.207557 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" event={"ID":"623f6cba-b644-4fc5-8163-07feed641333","Type":"ContainerStarted","Data":"7ac46db653a5ea9070c1b33e9fa1e0807311a817b0ab4ec16aa93d9aa53ba391"} Jul 08 19:02:37.207692 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.207611 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" event={"ID":"623f6cba-b644-4fc5-8163-07feed641333","Type":"ContainerStarted","Data":"37d58757bae16cb4bcf613f5316cc2b1e7146a613c040ba149bf59cfb463107f"} Jul 08 19:02:37.207692 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.207643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" event={"ID":"623f6cba-b644-4fc5-8163-07feed641333","Type":"ContainerStarted","Data":"961bf9b06987fbc5283cbd9d06cfdff1a60a3b59f92941bc5a7143da81e155ba"} Jul 08 19:02:37.209434 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.209409 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" event={"ID":"5b85877b-3481-48b7-a104-9ca6373c3683","Type":"ContainerStarted","Data":"5b88b7902e4fa18dc0cd97d5be6d44c1e7fab18651d24895f57a0cd5a0e009be"} Jul 08 19:02:37.211521 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.211495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9xfr" event={"ID":"e98bd1f1-7515-419e-8625-ea1499f4195b","Type":"ContainerStarted","Data":"da0ff060a131df9af158621aded887151a8631995303521a6558777af4c450b1"} Jul 08 19:02:37.211612 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.211545 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9xfr" event={"ID":"e98bd1f1-7515-419e-8625-ea1499f4195b","Type":"ContainerStarted","Data":"f37833c2eff5aab556570ee26b1b69ff3f529730dd063210c299c6554238de9c"} Jul 08 19:02:37.224874 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.224807 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-j5lk6" podStartSLOduration=4.416462899 podStartE2EDuration="6.224771013s" totalImagesPullingTime="1.808308114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:37.223406979 +0000 UTC m=+55.914398508" watchObservedRunningTime="2026-07-08 19:02:37.224771013 +0000 UTC m=+55.915762536" Jul 08 19:02:37.247920 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.247807 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-bc2sl" podStartSLOduration=4.199350875 podStartE2EDuration="6.247788893s" totalImagesPullingTime="2.048438018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:37.246232868 +0000 UTC m=+55.937224380" watchObservedRunningTime="2026-07-08 19:02:37.247788893 +0000 UTC m=+55.938780415" Jul 08 19:02:37.278349 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.278294 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t9xfr" podStartSLOduration=4.664264981 podStartE2EDuration="6.278277317s" totalImagesPullingTime="1.501482725s" totalInitContainerRuntime="112.529611ms" isStatefulPod=true podCreationTimestamp="2026-07-08 19:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:37.277306223 +0000 UTC m=+55.968297744" watchObservedRunningTime="2026-07-08 19:02:37.278277317 +0000 UTC m=+55.969268839" Jul 08 19:02:37.327194 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.327154 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65cc96494-8h9nc"] Jul 08 19:02:37.330567 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:37.330535 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e7eb729_1eaf_48f0_8099_8a85f81049b9.slice/crio-618ce6f2ee0a149588b4cf66933ee0fdc90a602b818259e1276481c51963d657 WatchSource:0}: Error finding container 618ce6f2ee0a149588b4cf66933ee0fdc90a602b818259e1276481c51963d657: Status 404 returned error can't find the container with id 618ce6f2ee0a149588b4cf66933ee0fdc90a602b818259e1276481c51963d657 Jul 08 19:02:37.877182 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.877147 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6f599599-k45fg"] Jul 08 19:02:37.879876 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.879847 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:37.893983 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.893953 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6f599599-k45fg"] Jul 08 19:02:37.992000 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.991960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-service-ca\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:37.992202 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.992013 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-oauth-serving-cert\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:37.992202 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.992069 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-oauth-config\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:37.992202 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.992124 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-config\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:37.992202 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.992155 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-serving-cert\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:37.992202 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.992192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-trusted-ca-bundle\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:37.992481 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:37.992275 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m7nl\" (UniqueName: \"kubernetes.io/projected/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-kube-api-access-4m7nl\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.093438 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.093377 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m7nl\" (UniqueName: \"kubernetes.io/projected/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-kube-api-access-4m7nl\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.093626 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.093456 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-service-ca\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.093626 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.093473 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-oauth-serving-cert\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.093626 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.093502 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-oauth-config\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.093626 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.093532 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-config\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.093626 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.093551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-serving-cert\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.093626 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.093573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-trusted-ca-bundle\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.094294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.094266 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-service-ca\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.094595 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.094274 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-config\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.094595 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.094274 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-oauth-serving-cert\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.094595 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.094500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-trusted-ca-bundle\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.096225 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.096194 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-oauth-config\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.096326 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.096302 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-serving-cert\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.108295 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.108267 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m7nl\" (UniqueName: \"kubernetes.io/projected/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-kube-api-access-4m7nl\") pod \"console-5f6f599599-k45fg\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.160682 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.160589 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sjvht" Jul 08 19:02:38.191443 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.191403 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:38.225327 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.225277 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" event={"ID":"9e7eb729-1eaf-48f0-8099-8a85f81049b9","Type":"ContainerStarted","Data":"618ce6f2ee0a149588b4cf66933ee0fdc90a602b818259e1276481c51963d657"} Jul 08 19:02:38.369304 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:38.369246 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6f599599-k45fg"] Jul 08 19:02:38.373206 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:38.373176 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd15d8d2_9b0f_4b7d_8c55_c6cbb56bdac5.slice/crio-a432596b409aaa0e6fe4771e209f86bf1193d3c2762a4be946dcaf79daaa7b31 WatchSource:0}: Error finding container a432596b409aaa0e6fe4771e209f86bf1193d3c2762a4be946dcaf79daaa7b31: Status 404 returned error can't find the container with id a432596b409aaa0e6fe4771e209f86bf1193d3c2762a4be946dcaf79daaa7b31 Jul 08 19:02:39.238422 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:39.237788 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f599599-k45fg" event={"ID":"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5","Type":"ContainerStarted","Data":"8c683af5099aa9caa63b21a4389470d85444b6066a9221edf076a92903213370"} Jul 08 19:02:39.238422 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:39.237898 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f599599-k45fg" event={"ID":"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5","Type":"ContainerStarted","Data":"a432596b409aaa0e6fe4771e209f86bf1193d3c2762a4be946dcaf79daaa7b31"} Jul 08 19:02:39.273680 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:39.273621 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6f599599-k45fg" podStartSLOduration=2.27359954 podStartE2EDuration="2.27359954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:39.273448953 +0000 UTC m=+57.964440476" watchObservedRunningTime="2026-07-08 19:02:39.27359954 +0000 UTC m=+57.964591063" Jul 08 19:02:40.247294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:40.247104 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e56622-4c7b-4686-b4bf-f9bfcbd11e96","Type":"ContainerStarted","Data":"8be6e887e4ba72d5a72282932eae33fd729178f7b2451873886d3239aaa99413"} Jul 08 19:02:40.247294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:40.247171 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e56622-4c7b-4686-b4bf-f9bfcbd11e96","Type":"ContainerStarted","Data":"db71453e881482271b7350011f8e119ba84d12d7437bc16b124a7f7d62b07c28"} Jul 08 19:02:40.247294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:40.247196 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e56622-4c7b-4686-b4bf-f9bfcbd11e96","Type":"ContainerStarted","Data":"11d8285686c752e1a9757834e7a9f66798b0b4794c8ec788e3ef8bd4df145856"} Jul 08 19:02:40.247294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:40.247220 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e56622-4c7b-4686-b4bf-f9bfcbd11e96","Type":"ContainerStarted","Data":"106d3f160551a704f5739b7a25d4940bfdbd6e1387e455fa610aa6a0a743d7e1"} Jul 08 19:02:40.247294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:40.247242 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e56622-4c7b-4686-b4bf-f9bfcbd11e96","Type":"ContainerStarted","Data":"0123446f314fc95731e72c35655e8c22309fb2ad3cb6ad911fc04715b54b70ec"} Jul 08 19:02:40.250813 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:40.250438 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" event={"ID":"5b85877b-3481-48b7-a104-9ca6373c3683","Type":"ContainerStarted","Data":"e6f73e445539c85fa8b85fbec16b0c892af07c34756483ce2ff872284a5de9ce"} Jul 08 19:02:40.250813 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:40.250505 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" event={"ID":"5b85877b-3481-48b7-a104-9ca6373c3683","Type":"ContainerStarted","Data":"6cddaca5e3339c7da8eae555d796bad7a8eea5687a7b336cbd229ec33d4da337"} Jul 08 19:02:40.250813 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:40.250535 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" event={"ID":"5b85877b-3481-48b7-a104-9ca6373c3683","Type":"ContainerStarted","Data":"c411cfd436288b096db7ef9a8572811dc9094871418180c223ab21b3acd956c1"} Jul 08 19:02:41.257339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:41.257297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" event={"ID":"9e7eb729-1eaf-48f0-8099-8a85f81049b9","Type":"ContainerStarted","Data":"00fc54cd69260d67a47966a827614f3356f485e933899edc052454940dc3a9fd"} Jul 08 19:02:41.257824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:41.257432 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" event={"ID":"9e7eb729-1eaf-48f0-8099-8a85f81049b9","Type":"ContainerStarted","Data":"078e9145ea4c9348e8c0df7f2d6dc1c8ae630bd0b7263c17124aa52e9e585dc8"} Jul 08 19:02:41.257824 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:41.257464 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" event={"ID":"9e7eb729-1eaf-48f0-8099-8a85f81049b9","Type":"ContainerStarted","Data":"b9bab9109e7d7b0d2f7a2b92db9a1e338de1313c4f63eee8feabef4b6ae1989f"} Jul 08 19:02:41.994488 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:41.994418 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65cc96494-8h9nc" podStartSLOduration=2.571925183 podStartE2EDuration="5.994365331s" totalImagesPullingTime="3.422440148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:41.286849795 +0000 UTC m=+59.977841332" watchObservedRunningTime="2026-07-08 19:02:41.994365331 +0000 UTC m=+60.685356855" Jul 08 19:02:41.995885 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:41.995857 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6f599599-k45fg"] Jul 08 19:02:42.048777 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.048737 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77467c6c77-xsp4t"] Jul 08 19:02:42.080405 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.080350 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77467c6c77-xsp4t"] Jul 08 19:02:42.080549 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.080476 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.134949 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.134909 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-oauth-serving-cert\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.134949 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.134946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzb6j\" (UniqueName: \"kubernetes.io/projected/515bc78f-e013-437d-9272-c39a6d79737d-kube-api-access-dzb6j\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.135188 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.134973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-oauth-config\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.135188 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.135001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-console-config\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.135188 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.135074 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-serving-cert\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.135188 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.135129 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-trusted-ca-bundle\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.135188 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.135157 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-service-ca\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.235999 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.235952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-serving-cert\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.236174 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.236032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-trusted-ca-bundle\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.236228 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.236204 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-service-ca\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.236282 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.236266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-oauth-serving-cert\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.236330 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.236296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzb6j\" (UniqueName: \"kubernetes.io/projected/515bc78f-e013-437d-9272-c39a6d79737d-kube-api-access-dzb6j\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.236376 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.236338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-oauth-config\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.236376 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.236363 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-console-config\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.236953 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.236927 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-trusted-ca-bundle\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.237055 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.236968 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-oauth-serving-cert\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.237055 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.237018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-service-ca\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.237175 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.237159 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-console-config\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.238665 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.238650 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-serving-cert\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.238894 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.238876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-oauth-config\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.245598 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.245536 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzb6j\" (UniqueName: \"kubernetes.io/projected/515bc78f-e013-437d-9272-c39a6d79737d-kube-api-access-dzb6j\") pod \"console-77467c6c77-xsp4t\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.264666 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.264625 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" event={"ID":"5b85877b-3481-48b7-a104-9ca6373c3683","Type":"ContainerStarted","Data":"9cd26e8a2e17d451ebd05a08d84f005d1d365b856dfbb0f2c6308cd272948666"} Jul 08 19:02:42.265099 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.264703 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" event={"ID":"5b85877b-3481-48b7-a104-9ca6373c3683","Type":"ContainerStarted","Data":"ce9f56d0e3c447b8da9bfddcbe39f694558fbeaa4b18efb7c84238cb96807f06"} Jul 08 19:02:42.265099 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.264737 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" event={"ID":"5b85877b-3481-48b7-a104-9ca6373c3683","Type":"ContainerStarted","Data":"b74b2c1c34f4d97d0fff270ef79be6ebad6fdb559a2a9fb4be25e52e884636fc"} Jul 08 19:02:42.265099 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.264779 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:42.267963 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.267933 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"34e56622-4c7b-4686-b4bf-f9bfcbd11e96","Type":"ContainerStarted","Data":"8bb4ced6d9eef22ebf70b7467651486413b704a474bd43d7c5b280280cb7e7a5"} Jul 08 19:02:42.346321 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.346265 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.822239205 podStartE2EDuration="10.346245393s" totalImagesPullingTime="6.500670927s" totalInitContainerRuntime="23.335261ms" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:42.34360476 +0000 UTC m=+61.034596284" watchObservedRunningTime="2026-07-08 19:02:42.346245393 +0000 UTC m=+61.037236916" Jul 08 19:02:42.346680 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.346657 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" podStartSLOduration=2.8238156930000002 podStartE2EDuration="7.346647293s" totalImagesPullingTime="4.5228316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:42.298077443 +0000 UTC m=+60.989068964" watchObservedRunningTime="2026-07-08 19:02:42.346647293 +0000 UTC m=+61.037638859" Jul 08 19:02:42.389973 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.389936 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:42.557732 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:42.557700 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77467c6c77-xsp4t"] Jul 08 19:02:42.561590 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:42.561562 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515bc78f_e013_437d_9272_c39a6d79737d.slice/crio-90cf504407e17df31a9b635d2b591408a33847a7bada9c6c32a79ca77555cb37 WatchSource:0}: Error finding container 90cf504407e17df31a9b635d2b591408a33847a7bada9c6c32a79ca77555cb37: Status 404 returned error can't find the container with id 90cf504407e17df31a9b635d2b591408a33847a7bada9c6c32a79ca77555cb37 Jul 08 19:02:43.274013 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:43.273971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77467c6c77-xsp4t" event={"ID":"515bc78f-e013-437d-9272-c39a6d79737d","Type":"ContainerStarted","Data":"447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140"} Jul 08 19:02:43.274500 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:43.274029 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77467c6c77-xsp4t" event={"ID":"515bc78f-e013-437d-9272-c39a6d79737d","Type":"ContainerStarted","Data":"90cf504407e17df31a9b635d2b591408a33847a7bada9c6c32a79ca77555cb37"} Jul 08 19:02:43.320142 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:43.320091 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77467c6c77-xsp4t" podStartSLOduration=1.320075536 podStartE2EDuration="1.320075536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:02:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:43.319926395 +0000 UTC m=+62.010917918" watchObservedRunningTime="2026-07-08 19:02:43.320075536 +0000 UTC m=+62.011067057" Jul 08 19:02:47.118371 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.118342 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtsff" Jul 08 19:02:47.491457 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.491420 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:47.491633 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.491465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:47.494180 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.494156 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 19:02:47.494938 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.494922 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 19:02:47.505141 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.505116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4cc34c95-fd99-488a-9325-4056ffe2c48a-original-pull-secret\") pod \"global-pull-secret-syncer-2h4tw\" (UID: \"4cc34c95-fd99-488a-9325-4056ffe2c48a\") " pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:47.505588 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.505572 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 19:02:47.515865 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.515842 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkb76\" (UniqueName: \"kubernetes.io/projected/9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7-kube-api-access-kkb76\") pod \"network-check-target-2slmq\" (UID: \"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7\") " pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:47.576243 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.576211 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-db4b9\"" Jul 08 19:02:47.582085 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.582062 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:47.583343 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.583323 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2h4tw" Jul 08 19:02:47.592139 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.592103 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:47.594901 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.594874 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 19:02:47.605984 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.605961 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eb492e2e-7cb5-43e7-b25e-4507b7fa2d28-metrics-certs\") pod \"network-metrics-daemon-vk797\" (UID: \"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28\") " pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:47.760700 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.760605 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2h4tw"] Jul 08 19:02:47.764378 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:47.764347 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc34c95_fd99_488a_9325_4056ffe2c48a.slice/crio-b3a4976227251e65daf9f8e4236a0ca2588df583ed45ba597f0e35508197dffd WatchSource:0}: Error finding container b3a4976227251e65daf9f8e4236a0ca2588df583ed45ba597f0e35508197dffd: Status 404 returned error can't find the container with id b3a4976227251e65daf9f8e4236a0ca2588df583ed45ba597f0e35508197dffd Jul 08 19:02:47.768133 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.768110 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2slmq"] Jul 08 19:02:47.771163 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:47.771135 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf6da07_e786_419c_8ba0_d4dcc0c6c4a7.slice/crio-46153b6b70a5cb2242e89fb393be8b57fe0f6e11f1b7638656ca6202ad165c2e WatchSource:0}: Error finding container 46153b6b70a5cb2242e89fb393be8b57fe0f6e11f1b7638656ca6202ad165c2e: Status 404 returned error can't find the container with id 46153b6b70a5cb2242e89fb393be8b57fe0f6e11f1b7638656ca6202ad165c2e Jul 08 19:02:47.906530 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.906495 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-72lbb\"" Jul 08 19:02:47.911155 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:47.911135 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vk797" Jul 08 19:02:48.068842 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:48.068742 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vk797"] Jul 08 19:02:48.071410 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:02:48.071369 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb492e2e_7cb5_43e7_b25e_4507b7fa2d28.slice/crio-b0d1413eded7dbc402eab144f3b12f0edc7d9001012db6d8741cbf9b0d4ec2cb WatchSource:0}: Error finding container b0d1413eded7dbc402eab144f3b12f0edc7d9001012db6d8741cbf9b0d4ec2cb: Status 404 returned error can't find the container with id b0d1413eded7dbc402eab144f3b12f0edc7d9001012db6d8741cbf9b0d4ec2cb Jul 08 19:02:48.191566 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:48.191527 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:02:48.280826 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:48.280801 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-657666f54d-8wqvb" Jul 08 19:02:48.295532 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:48.295495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vk797" event={"ID":"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28","Type":"ContainerStarted","Data":"b0d1413eded7dbc402eab144f3b12f0edc7d9001012db6d8741cbf9b0d4ec2cb"} Jul 08 19:02:48.296657 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:48.296626 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2h4tw" event={"ID":"4cc34c95-fd99-488a-9325-4056ffe2c48a","Type":"ContainerStarted","Data":"b3a4976227251e65daf9f8e4236a0ca2588df583ed45ba597f0e35508197dffd"} Jul 08 19:02:48.297858 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:48.297838 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2slmq" event={"ID":"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7","Type":"ContainerStarted","Data":"46153b6b70a5cb2242e89fb393be8b57fe0f6e11f1b7638656ca6202ad165c2e"} Jul 08 19:02:50.313426 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:50.313363 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vk797" event={"ID":"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28","Type":"ContainerStarted","Data":"2be8e33167cbd53a94e84f6441b414fd64ebbb7aab0096d28f69ea123b8ee998"} Jul 08 19:02:51.320848 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:51.320807 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vk797" event={"ID":"eb492e2e-7cb5-43e7-b25e-4507b7fa2d28","Type":"ContainerStarted","Data":"c0c41679d573a84fe2f818a70e31696ce0edb4d9848119b8705052f496f67622"} Jul 08 19:02:52.390617 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:52.390572 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:52.391090 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:52.390652 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:52.396269 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:52.396240 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:52.423531 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:52.423475 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vk797" podStartSLOduration=68.484764461 podStartE2EDuration="1m10.423458169s" totalImagesPullingTime="1.938693708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:51.345739975 +0000 UTC m=+70.036731497" watchObservedRunningTime="2026-07-08 19:02:52.423458169 +0000 UTC m=+71.114449688" Jul 08 19:02:53.333636 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:53.333599 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:02:53.412423 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:53.412376 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6775f7d584-s7ndl"] Jul 08 19:02:54.335459 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:54.335412 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2h4tw" event={"ID":"4cc34c95-fd99-488a-9325-4056ffe2c48a","Type":"ContainerStarted","Data":"930e9eb3fdfee8b698cb31f63e79869a4a6b1f7a4567b54de399f19b60da3e7e"} Jul 08 19:02:54.336994 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:54.336971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2slmq" event={"ID":"9bf6da07-e786-419c-8ba0-d4dcc0c6c4a7","Type":"ContainerStarted","Data":"f3e4bba6bdf66304ac6d310b8e6436533ad1ba468dbc45e192ffb57aa7f579b7"} Jul 08 19:02:54.337135 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:54.337040 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:02:54.369720 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:54.369666 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2h4tw" podStartSLOduration=66.813000411 podStartE2EDuration="1m12.369649319s" totalImagesPullingTime="5.556648908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:54.368516187 +0000 UTC m=+73.059507710" watchObservedRunningTime="2026-07-08 19:02:54.369649319 +0000 UTC m=+73.060640841" Jul 08 19:02:54.390026 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:02:54.389972 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2slmq" podStartSLOduration=66.841053209 podStartE2EDuration="1m12.389953241s" totalImagesPullingTime="5.548900032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:02:54.388690915 +0000 UTC m=+73.079682438" watchObservedRunningTime="2026-07-08 19:02:54.389953241 +0000 UTC m=+73.080944763" Jul 08 19:03:07.017848 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.017713 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f6f599599-k45fg" podUID="fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" containerName="console" containerID="cri-o://8c683af5099aa9caa63b21a4389470d85444b6066a9221edf076a92903213370" gracePeriod=15 Jul 08 19:03:07.395689 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.395596 2560 generic.go:356] "Generic (PLEG): container finished" podID="fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" containerID="8c683af5099aa9caa63b21a4389470d85444b6066a9221edf076a92903213370" exitCode=0 Jul 08 19:03:07.395862 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.395679 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f599599-k45fg" event={"ID":"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5","Type":"ContainerDied","Data":"8c683af5099aa9caa63b21a4389470d85444b6066a9221edf076a92903213370"} Jul 08 19:03:07.791793 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.791759 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:03:07.880767 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.880731 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-serving-cert\") pod \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " Jul 08 19:03:07.880980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.880789 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-config\") pod \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " Jul 08 19:03:07.880980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.880855 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-service-ca\") pod \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " Jul 08 19:03:07.880980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.880888 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m7nl\" (UniqueName: \"kubernetes.io/projected/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-kube-api-access-4m7nl\") pod \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " Jul 08 19:03:07.880980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.880921 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-trusted-ca-bundle\") pod \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " Jul 08 19:03:07.880980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.880945 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-oauth-config\") pod \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " Jul 08 19:03:07.881241 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.880988 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-oauth-serving-cert\") pod \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\" (UID: \"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5\") " Jul 08 19:03:07.881306 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.881249 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-config" (OuterVolumeSpecName: "console-config") pod "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" (UID: "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:07.881361 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.881338 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" (UID: "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:07.881361 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.881341 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" (UID: "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:07.881507 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.881459 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" (UID: "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:07.881687 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.881658 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-trusted-ca-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:07.881687 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.881680 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-oauth-serving-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:07.881778 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.881695 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-config\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:07.881778 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.881708 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-service-ca\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:07.883545 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.883520 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" (UID: "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:03:07.883707 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.883685 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" (UID: "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:03:07.883760 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.883698 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-kube-api-access-4m7nl" (OuterVolumeSpecName: "kube-api-access-4m7nl") pod "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" (UID: "fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5"). InnerVolumeSpecName "kube-api-access-4m7nl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:03:07.982435 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.982378 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-serving-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:07.982435 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.982429 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m7nl\" (UniqueName: \"kubernetes.io/projected/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-kube-api-access-4m7nl\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:07.982435 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:07.982439 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5-console-oauth-config\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:08.400930 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:08.400904 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6f599599-k45fg" Jul 08 19:03:08.400930 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:08.400910 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6f599599-k45fg" event={"ID":"fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5","Type":"ContainerDied","Data":"a432596b409aaa0e6fe4771e209f86bf1193d3c2762a4be946dcaf79daaa7b31"} Jul 08 19:03:08.401376 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:08.400990 2560 scope.go:117] "RemoveContainer" containerID="8c683af5099aa9caa63b21a4389470d85444b6066a9221edf076a92903213370" Jul 08 19:03:08.427304 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:08.427267 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6f599599-k45fg"] Jul 08 19:03:08.433006 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:08.432980 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f6f599599-k45fg"] Jul 08 19:03:09.958325 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:09.958287 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" path="/var/lib/kubelet/pods/fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5/volumes" Jul 08 19:03:18.436843 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.436768 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6775f7d584-s7ndl" podUID="207335dc-c0c4-4ece-bf0c-c5c27830b85c" containerName="console" containerID="cri-o://e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5" gracePeriod=15 Jul 08 19:03:18.692039 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.691977 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:03:18.771692 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.771648 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-oauth-config\") pod \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " Jul 08 19:03:18.771692 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.771698 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-service-ca\") pod \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " Jul 08 19:03:18.771958 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.771739 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-serving-cert\") pod \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " Jul 08 19:03:18.771958 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.771760 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-oauth-serving-cert\") pod \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " Jul 08 19:03:18.771958 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.771784 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsbdz\" (UniqueName: \"kubernetes.io/projected/207335dc-c0c4-4ece-bf0c-c5c27830b85c-kube-api-access-vsbdz\") pod \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " Jul 08 19:03:18.771958 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.771819 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-config\") pod \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " Jul 08 19:03:18.771958 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.771880 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-trusted-ca-bundle\") pod \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\" (UID: \"207335dc-c0c4-4ece-bf0c-c5c27830b85c\") " Jul 08 19:03:18.772272 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.772238 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "207335dc-c0c4-4ece-bf0c-c5c27830b85c" (UID: "207335dc-c0c4-4ece-bf0c-c5c27830b85c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:18.772272 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.772253 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-service-ca" (OuterVolumeSpecName: "service-ca") pod "207335dc-c0c4-4ece-bf0c-c5c27830b85c" (UID: "207335dc-c0c4-4ece-bf0c-c5c27830b85c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:18.772487 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.772444 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "207335dc-c0c4-4ece-bf0c-c5c27830b85c" (UID: "207335dc-c0c4-4ece-bf0c-c5c27830b85c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:18.772711 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.772479 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-config" (OuterVolumeSpecName: "console-config") pod "207335dc-c0c4-4ece-bf0c-c5c27830b85c" (UID: "207335dc-c0c4-4ece-bf0c-c5c27830b85c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:03:18.774317 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.774283 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "207335dc-c0c4-4ece-bf0c-c5c27830b85c" (UID: "207335dc-c0c4-4ece-bf0c-c5c27830b85c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:03:18.774317 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.774311 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207335dc-c0c4-4ece-bf0c-c5c27830b85c-kube-api-access-vsbdz" (OuterVolumeSpecName: "kube-api-access-vsbdz") pod "207335dc-c0c4-4ece-bf0c-c5c27830b85c" (UID: "207335dc-c0c4-4ece-bf0c-c5c27830b85c"). InnerVolumeSpecName "kube-api-access-vsbdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:03:18.774473 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.774326 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "207335dc-c0c4-4ece-bf0c-c5c27830b85c" (UID: "207335dc-c0c4-4ece-bf0c-c5c27830b85c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:03:18.872756 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.872716 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-trusted-ca-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:18.872756 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.872747 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-oauth-config\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:18.872756 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.872757 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-service-ca\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:18.872756 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.872766 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-serving-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:18.873027 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.872774 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-oauth-serving-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:18.873027 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.872782 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsbdz\" (UniqueName: \"kubernetes.io/projected/207335dc-c0c4-4ece-bf0c-c5c27830b85c-kube-api-access-vsbdz\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:18.873027 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:18.872791 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/207335dc-c0c4-4ece-bf0c-c5c27830b85c-console-config\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:03:19.450110 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.450074 2560 generic.go:356] "Generic (PLEG): container finished" podID="207335dc-c0c4-4ece-bf0c-c5c27830b85c" containerID="e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5" exitCode=0 Jul 08 19:03:19.450556 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.450116 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6775f7d584-s7ndl" Jul 08 19:03:19.450556 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.450163 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6775f7d584-s7ndl" event={"ID":"207335dc-c0c4-4ece-bf0c-c5c27830b85c","Type":"ContainerDied","Data":"e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5"} Jul 08 19:03:19.450556 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.450222 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6775f7d584-s7ndl" event={"ID":"207335dc-c0c4-4ece-bf0c-c5c27830b85c","Type":"ContainerDied","Data":"dd076831ec7308b8b23088c8e18147977bc8a81fc53fa9ff5b1907ef63edc127"} Jul 08 19:03:19.450556 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.450244 2560 scope.go:117] "RemoveContainer" containerID="e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5" Jul 08 19:03:19.458914 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.458897 2560 scope.go:117] "RemoveContainer" containerID="e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5" Jul 08 19:03:19.459226 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:03:19.459206 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5\": container with ID starting with e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5 not found: ID does not exist" containerID="e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5" Jul 08 19:03:19.459270 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.459237 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5"} err="failed to get container status \"e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5\": rpc error: code = NotFound desc = could not find container \"e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5\": container with ID starting with e3378e3db7cb2a6e6fc7bfa018bb543ec3340e26c8db5ad148193e99d9297ff5 not found: ID does not exist" Jul 08 19:03:19.470949 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.470921 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6775f7d584-s7ndl"] Jul 08 19:03:19.475665 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.475639 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6775f7d584-s7ndl"] Jul 08 19:03:19.958043 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:19.958007 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="207335dc-c0c4-4ece-bf0c-c5c27830b85c" path="/var/lib/kubelet/pods/207335dc-c0c4-4ece-bf0c-c5c27830b85c/volumes" Jul 08 19:03:25.343531 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:25.343500 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2slmq" Jul 08 19:03:48.524270 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.524231 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55d5fbcc97-7zrfn"] Jul 08 19:03:48.524766 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.524581 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207335dc-c0c4-4ece-bf0c-c5c27830b85c" containerName="console" Jul 08 19:03:48.524766 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.524593 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="207335dc-c0c4-4ece-bf0c-c5c27830b85c" containerName="console" Jul 08 19:03:48.524766 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.524601 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" containerName="console" Jul 08 19:03:48.524766 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.524608 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" containerName="console" Jul 08 19:03:48.524766 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.524651 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="207335dc-c0c4-4ece-bf0c-c5c27830b85c" containerName="console" Jul 08 19:03:48.524766 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.524658 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd15d8d2-9b0f-4b7d-8c55-c6cbb56bdac5" containerName="console" Jul 08 19:03:48.527420 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.527398 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.543360 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.543323 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d5fbcc97-7zrfn"] Jul 08 19:03:48.625754 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.625720 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-oauth-serving-cert\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.625754 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.625761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-console-config\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.625985 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.625790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-trusted-ca-bundle\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.625985 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.625857 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfvzf\" (UniqueName: \"kubernetes.io/projected/61134e51-b573-40a9-9ae0-3831d70600a4-kube-api-access-gfvzf\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.625985 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.625878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-oauth-config\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.625985 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.625918 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-serving-cert\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.625985 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.625973 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-service-ca\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.726890 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.726846 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-console-config\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727048 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.726898 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-trusted-ca-bundle\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727048 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.726933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfvzf\" (UniqueName: \"kubernetes.io/projected/61134e51-b573-40a9-9ae0-3831d70600a4-kube-api-access-gfvzf\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727048 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.726952 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-oauth-config\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727048 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.727005 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-serving-cert\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727048 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.727031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-service-ca\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727293 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.727072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-oauth-serving-cert\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727717 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.727694 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-console-config\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727928 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.727908 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-oauth-serving-cert\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.727989 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.727908 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-trusted-ca-bundle\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.728084 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.728060 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-service-ca\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.729601 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.729571 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-oauth-config\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.729731 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.729711 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-serving-cert\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.739919 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.739897 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfvzf\" (UniqueName: \"kubernetes.io/projected/61134e51-b573-40a9-9ae0-3831d70600a4-kube-api-access-gfvzf\") pod \"console-55d5fbcc97-7zrfn\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.836753 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.836657 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:48.979008 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:48.978795 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55d5fbcc97-7zrfn"] Jul 08 19:03:48.981766 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:03:48.981738 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61134e51_b573_40a9_9ae0_3831d70600a4.slice/crio-82dbaec80a953cec48a907c2329f02b2f7136d312f3d48da7581d5b72f6af059 WatchSource:0}: Error finding container 82dbaec80a953cec48a907c2329f02b2f7136d312f3d48da7581d5b72f6af059: Status 404 returned error can't find the container with id 82dbaec80a953cec48a907c2329f02b2f7136d312f3d48da7581d5b72f6af059 Jul 08 19:03:49.570053 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:49.569996 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5fbcc97-7zrfn" event={"ID":"61134e51-b573-40a9-9ae0-3831d70600a4","Type":"ContainerStarted","Data":"2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3"} Jul 08 19:03:49.570499 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:49.570079 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5fbcc97-7zrfn" event={"ID":"61134e51-b573-40a9-9ae0-3831d70600a4","Type":"ContainerStarted","Data":"82dbaec80a953cec48a907c2329f02b2f7136d312f3d48da7581d5b72f6af059"} Jul 08 19:03:49.593729 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:49.593676 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55d5fbcc97-7zrfn" podStartSLOduration=1.593656712 podStartE2EDuration="1.593656712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:03:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:03:49.591552946 +0000 UTC m=+128.282544480" watchObservedRunningTime="2026-07-08 19:03:49.593656712 +0000 UTC m=+128.284648234" Jul 08 19:03:58.836987 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:58.836941 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:58.837542 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:58.837007 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:58.841935 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:58.841909 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:59.612262 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:59.612234 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:03:59.679043 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:03:59.679001 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77467c6c77-xsp4t"] Jul 08 19:04:24.701680 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:24.701607 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77467c6c77-xsp4t" podUID="515bc78f-e013-437d-9272-c39a6d79737d" containerName="console" containerID="cri-o://447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140" gracePeriod=15 Jul 08 19:04:24.970695 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:24.970670 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:04:25.153116 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153075 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-console-config\") pod \"515bc78f-e013-437d-9272-c39a6d79737d\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " Jul 08 19:04:25.153116 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153118 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-trusted-ca-bundle\") pod \"515bc78f-e013-437d-9272-c39a6d79737d\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " Jul 08 19:04:25.153479 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153148 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-serving-cert\") pod \"515bc78f-e013-437d-9272-c39a6d79737d\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " Jul 08 19:04:25.153479 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153165 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-service-ca\") pod \"515bc78f-e013-437d-9272-c39a6d79737d\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " Jul 08 19:04:25.153479 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153200 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzb6j\" (UniqueName: \"kubernetes.io/projected/515bc78f-e013-437d-9272-c39a6d79737d-kube-api-access-dzb6j\") pod \"515bc78f-e013-437d-9272-c39a6d79737d\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " Jul 08 19:04:25.153479 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153261 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-oauth-serving-cert\") pod \"515bc78f-e013-437d-9272-c39a6d79737d\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " Jul 08 19:04:25.153479 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153330 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-oauth-config\") pod \"515bc78f-e013-437d-9272-c39a6d79737d\" (UID: \"515bc78f-e013-437d-9272-c39a6d79737d\") " Jul 08 19:04:25.153751 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153694 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-console-config" (OuterVolumeSpecName: "console-config") pod "515bc78f-e013-437d-9272-c39a6d79737d" (UID: "515bc78f-e013-437d-9272-c39a6d79737d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:04:25.153751 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153718 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "515bc78f-e013-437d-9272-c39a6d79737d" (UID: "515bc78f-e013-437d-9272-c39a6d79737d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:04:25.153862 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153830 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-service-ca" (OuterVolumeSpecName: "service-ca") pod "515bc78f-e013-437d-9272-c39a6d79737d" (UID: "515bc78f-e013-437d-9272-c39a6d79737d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:04:25.153957 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.153877 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "515bc78f-e013-437d-9272-c39a6d79737d" (UID: "515bc78f-e013-437d-9272-c39a6d79737d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:04:25.155923 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.155884 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "515bc78f-e013-437d-9272-c39a6d79737d" (UID: "515bc78f-e013-437d-9272-c39a6d79737d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:04:25.156035 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.155932 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/515bc78f-e013-437d-9272-c39a6d79737d-kube-api-access-dzb6j" (OuterVolumeSpecName: "kube-api-access-dzb6j") pod "515bc78f-e013-437d-9272-c39a6d79737d" (UID: "515bc78f-e013-437d-9272-c39a6d79737d"). InnerVolumeSpecName "kube-api-access-dzb6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:04:25.156035 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.155957 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "515bc78f-e013-437d-9272-c39a6d79737d" (UID: "515bc78f-e013-437d-9272-c39a6d79737d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:04:25.254270 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.254227 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzb6j\" (UniqueName: \"kubernetes.io/projected/515bc78f-e013-437d-9272-c39a6d79737d-kube-api-access-dzb6j\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:04:25.254270 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.254258 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-oauth-serving-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:04:25.254270 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.254267 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-oauth-config\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:04:25.254270 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.254276 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-console-config\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:04:25.254577 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.254285 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-trusted-ca-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:04:25.254577 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.254293 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/515bc78f-e013-437d-9272-c39a6d79737d-console-serving-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:04:25.254577 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.254302 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/515bc78f-e013-437d-9272-c39a6d79737d-service-ca\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:04:25.716847 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.716807 2560 generic.go:356] "Generic (PLEG): container finished" podID="515bc78f-e013-437d-9272-c39a6d79737d" containerID="447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140" exitCode=0 Jul 08 19:04:25.717314 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.716860 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77467c6c77-xsp4t" Jul 08 19:04:25.717314 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.716862 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77467c6c77-xsp4t" event={"ID":"515bc78f-e013-437d-9272-c39a6d79737d","Type":"ContainerDied","Data":"447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140"} Jul 08 19:04:25.717314 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.716997 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77467c6c77-xsp4t" event={"ID":"515bc78f-e013-437d-9272-c39a6d79737d","Type":"ContainerDied","Data":"90cf504407e17df31a9b635d2b591408a33847a7bada9c6c32a79ca77555cb37"} Jul 08 19:04:25.717314 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.717022 2560 scope.go:117] "RemoveContainer" containerID="447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140" Jul 08 19:04:25.725870 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.725850 2560 scope.go:117] "RemoveContainer" containerID="447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140" Jul 08 19:04:25.726162 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:04:25.726138 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140\": container with ID starting with 447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140 not found: ID does not exist" containerID="447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140" Jul 08 19:04:25.726223 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.726177 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140"} err="failed to get container status \"447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140\": rpc error: code = NotFound desc = could not find container \"447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140\": container with ID starting with 447e07deab9e8a069f9e0a615dfc6de5ba0c95ab853808d21243769f7ea56140 not found: ID does not exist" Jul 08 19:04:25.736598 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.736570 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77467c6c77-xsp4t"] Jul 08 19:04:25.740021 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.739999 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77467c6c77-xsp4t"] Jul 08 19:04:25.958691 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:25.958650 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="515bc78f-e013-437d-9272-c39a6d79737d" path="/var/lib/kubelet/pods/515bc78f-e013-437d-9272-c39a6d79737d/volumes" Jul 08 19:04:51.914034 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.914000 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q"] Jul 08 19:04:51.914578 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.914293 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="515bc78f-e013-437d-9272-c39a6d79737d" containerName="console" Jul 08 19:04:51.914578 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.914305 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="515bc78f-e013-437d-9272-c39a6d79737d" containerName="console" Jul 08 19:04:51.914578 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.914367 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="515bc78f-e013-437d-9272-c39a6d79737d" containerName="console" Jul 08 19:04:51.918815 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.918799 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:51.920922 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.920896 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 19:04:51.921044 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.920906 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 19:04:51.921044 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.920940 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qp66r\"" Jul 08 19:04:51.927092 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.927067 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q"] Jul 08 19:04:51.968308 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.968264 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:51.968529 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.968319 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:51.968529 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:51.968405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9z4l\" (UniqueName: \"kubernetes.io/projected/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-kube-api-access-l9z4l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:52.069653 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.069605 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:52.069831 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.069660 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:52.069831 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.069782 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9z4l\" (UniqueName: \"kubernetes.io/projected/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-kube-api-access-l9z4l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:52.070024 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.069998 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:52.070092 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.070045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:52.078484 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.078458 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9z4l\" (UniqueName: \"kubernetes.io/projected/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-kube-api-access-l9z4l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:52.228416 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.228362 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:04:52.365689 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.365656 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q"] Jul 08 19:04:52.369703 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:04:52.369671 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac84aa73_b7d8_4644_bb84_bb2ba36a39a9.slice/crio-53c3631a61193d29c6c19e5d18bd88cfa7fdb1349734fb422bd92703a1021e19 WatchSource:0}: Error finding container 53c3631a61193d29c6c19e5d18bd88cfa7fdb1349734fb422bd92703a1021e19: Status 404 returned error can't find the container with id 53c3631a61193d29c6c19e5d18bd88cfa7fdb1349734fb422bd92703a1021e19 Jul 08 19:04:52.823262 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:04:52.823224 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" event={"ID":"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9","Type":"ContainerStarted","Data":"53c3631a61193d29c6c19e5d18bd88cfa7fdb1349734fb422bd92703a1021e19"} Jul 08 19:05:02.865843 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:02.865794 2560 generic.go:356] "Generic (PLEG): container finished" podID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerID="fcaeaa3b5f494581b8faabbc0d42678c78f8f88e69c56b86e89ae25e972cfed6" exitCode=0 Jul 08 19:05:02.866294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:02.865882 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" event={"ID":"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9","Type":"ContainerDied","Data":"fcaeaa3b5f494581b8faabbc0d42678c78f8f88e69c56b86e89ae25e972cfed6"} Jul 08 19:05:07.888809 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:07.888725 2560 generic.go:356] "Generic (PLEG): container finished" podID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerID="005e6d49d4c16dfcb925768b985777619cd37f5e66daa137dc6794133da992b7" exitCode=0 Jul 08 19:05:07.889163 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:07.888807 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" event={"ID":"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9","Type":"ContainerDied","Data":"005e6d49d4c16dfcb925768b985777619cd37f5e66daa137dc6794133da992b7"} Jul 08 19:05:15.927663 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:15.927575 2560 generic.go:356] "Generic (PLEG): container finished" podID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerID="a82e6739ec35eedc007aaec820472a74305abf4f4aeeb11bad1b18c163f5b05a" exitCode=0 Jul 08 19:05:15.928033 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:15.927667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" event={"ID":"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9","Type":"ContainerDied","Data":"a82e6739ec35eedc007aaec820472a74305abf4f4aeeb11bad1b18c163f5b05a"} Jul 08 19:05:17.064399 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.064363 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:05:17.200232 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.200133 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-util\") pod \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " Jul 08 19:05:17.200232 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.200176 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9z4l\" (UniqueName: \"kubernetes.io/projected/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-kube-api-access-l9z4l\") pod \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " Jul 08 19:05:17.200232 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.200219 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-bundle\") pod \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\" (UID: \"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9\") " Jul 08 19:05:17.201059 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.201029 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-bundle" (OuterVolumeSpecName: "bundle") pod "ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" (UID: "ac84aa73-b7d8-4644-bb84-bb2ba36a39a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:17.202610 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.202577 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-kube-api-access-l9z4l" (OuterVolumeSpecName: "kube-api-access-l9z4l") pod "ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" (UID: "ac84aa73-b7d8-4644-bb84-bb2ba36a39a9"). InnerVolumeSpecName "kube-api-access-l9z4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:05:17.204899 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.204875 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-util" (OuterVolumeSpecName: "util") pod "ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" (UID: "ac84aa73-b7d8-4644-bb84-bb2ba36a39a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:17.301322 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.301278 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9z4l\" (UniqueName: \"kubernetes.io/projected/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-kube-api-access-l9z4l\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:05:17.301322 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.301315 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:05:17.301322 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.301324 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac84aa73-b7d8-4644-bb84-bb2ba36a39a9-util\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:05:17.936916 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.936882 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" event={"ID":"ac84aa73-b7d8-4644-bb84-bb2ba36a39a9","Type":"ContainerDied","Data":"53c3631a61193d29c6c19e5d18bd88cfa7fdb1349734fb422bd92703a1021e19"} Jul 08 19:05:17.937092 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.936923 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lkn4q" Jul 08 19:05:17.937092 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:17.936935 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53c3631a61193d29c6c19e5d18bd88cfa7fdb1349734fb422bd92703a1021e19" Jul 08 19:05:24.716059 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.716016 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz"] Jul 08 19:05:24.716594 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.716364 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerName="util" Jul 08 19:05:24.716594 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.716377 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerName="util" Jul 08 19:05:24.716594 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.716407 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerName="pull" Jul 08 19:05:24.716594 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.716413 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerName="pull" Jul 08 19:05:24.716594 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.716422 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerName="extract" Jul 08 19:05:24.716594 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.716428 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerName="extract" Jul 08 19:05:24.716594 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.716480 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac84aa73-b7d8-4644-bb84-bb2ba36a39a9" containerName="extract" Jul 08 19:05:24.720266 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.720245 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" Jul 08 19:05:24.722496 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.722471 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:24.722496 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.722490 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-x6kq2\"" Jul 08 19:05:24.722648 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.722513 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:24.731550 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.731519 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz"] Jul 08 19:05:24.758152 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.758122 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f5xh\" (UniqueName: \"kubernetes.io/projected/8aedf1b5-37cf-4973-894f-f1c182460457-kube-api-access-7f5xh\") pod \"cert-manager-operator-controller-manager-55c444bf86-f6bnz\" (UID: \"8aedf1b5-37cf-4973-894f-f1c182460457\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" Jul 08 19:05:24.758152 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.758161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aedf1b5-37cf-4973-894f-f1c182460457-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f6bnz\" (UID: \"8aedf1b5-37cf-4973-894f-f1c182460457\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" Jul 08 19:05:24.859215 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.859178 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f5xh\" (UniqueName: \"kubernetes.io/projected/8aedf1b5-37cf-4973-894f-f1c182460457-kube-api-access-7f5xh\") pod \"cert-manager-operator-controller-manager-55c444bf86-f6bnz\" (UID: \"8aedf1b5-37cf-4973-894f-f1c182460457\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" Jul 08 19:05:24.859215 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.859215 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aedf1b5-37cf-4973-894f-f1c182460457-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f6bnz\" (UID: \"8aedf1b5-37cf-4973-894f-f1c182460457\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" Jul 08 19:05:24.859618 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.859601 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aedf1b5-37cf-4973-894f-f1c182460457-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f6bnz\" (UID: \"8aedf1b5-37cf-4973-894f-f1c182460457\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" Jul 08 19:05:24.868534 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:24.868512 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f5xh\" (UniqueName: \"kubernetes.io/projected/8aedf1b5-37cf-4973-894f-f1c182460457-kube-api-access-7f5xh\") pod \"cert-manager-operator-controller-manager-55c444bf86-f6bnz\" (UID: \"8aedf1b5-37cf-4973-894f-f1c182460457\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" Jul 08 19:05:25.030011 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:25.029922 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" Jul 08 19:05:25.170767 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:25.170736 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz"] Jul 08 19:05:25.174259 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:05:25.174226 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aedf1b5_37cf_4973_894f_f1c182460457.slice/crio-1620e1d19ed5c2adbc31a7c3c078228ed44956e0febf69c7a631f206e41103ed WatchSource:0}: Error finding container 1620e1d19ed5c2adbc31a7c3c078228ed44956e0febf69c7a631f206e41103ed: Status 404 returned error can't find the container with id 1620e1d19ed5c2adbc31a7c3c078228ed44956e0febf69c7a631f206e41103ed Jul 08 19:05:25.968180 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:25.968148 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" event={"ID":"8aedf1b5-37cf-4973-894f-f1c182460457","Type":"ContainerStarted","Data":"1620e1d19ed5c2adbc31a7c3c078228ed44956e0febf69c7a631f206e41103ed"} Jul 08 19:05:27.978406 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:27.978346 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" event={"ID":"8aedf1b5-37cf-4973-894f-f1c182460457","Type":"ContainerStarted","Data":"8c992d4d1fa042c10f36ac354d3fc1eda11324ca6f325a520553c78ce4167fb0"} Jul 08 19:05:28.002975 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.002916 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f6bnz" podStartSLOduration=2.21913652 podStartE2EDuration="4.002897869s" totalImagesPullingTime="1.783761349s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:28.002616091 +0000 UTC m=+226.693607614" watchObservedRunningTime="2026-07-08 19:05:28.002897869 +0000 UTC m=+226.693889391" Jul 08 19:05:28.876777 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.876738 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r66z8"] Jul 08 19:05:28.879048 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.879024 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:28.881049 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.881032 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 19:05:28.881481 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.881466 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-x8xgs\"" Jul 08 19:05:28.881481 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.881475 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 19:05:28.890404 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.890010 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r66z8"] Jul 08 19:05:28.893952 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.893911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg5s6\" (UniqueName: \"kubernetes.io/projected/3d8e5161-d3e7-4a3e-b967-072f9e4aa22f-kube-api-access-wg5s6\") pod \"cert-manager-webhook-6486ffd997-r66z8\" (UID: \"3d8e5161-d3e7-4a3e-b967-072f9e4aa22f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:28.894045 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.893982 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d8e5161-d3e7-4a3e-b967-072f9e4aa22f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r66z8\" (UID: \"3d8e5161-d3e7-4a3e-b967-072f9e4aa22f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:28.994506 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.994464 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg5s6\" (UniqueName: \"kubernetes.io/projected/3d8e5161-d3e7-4a3e-b967-072f9e4aa22f-kube-api-access-wg5s6\") pod \"cert-manager-webhook-6486ffd997-r66z8\" (UID: \"3d8e5161-d3e7-4a3e-b967-072f9e4aa22f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:28.994506 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:28.994512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d8e5161-d3e7-4a3e-b967-072f9e4aa22f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r66z8\" (UID: \"3d8e5161-d3e7-4a3e-b967-072f9e4aa22f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:29.002886 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.002854 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d8e5161-d3e7-4a3e-b967-072f9e4aa22f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r66z8\" (UID: \"3d8e5161-d3e7-4a3e-b967-072f9e4aa22f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:29.003039 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.003015 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg5s6\" (UniqueName: \"kubernetes.io/projected/3d8e5161-d3e7-4a3e-b967-072f9e4aa22f-kube-api-access-wg5s6\") pod \"cert-manager-webhook-6486ffd997-r66z8\" (UID: \"3d8e5161-d3e7-4a3e-b967-072f9e4aa22f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:29.207028 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.206934 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:29.208842 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.208810 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl"] Jul 08 19:05:29.211560 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.211540 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.213869 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.213837 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 19:05:29.214283 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.214265 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 19:05:29.214515 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.214494 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qp66r\"" Jul 08 19:05:29.221422 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.221398 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl"] Jul 08 19:05:29.297906 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.297874 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.298056 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.297938 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.298056 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.297967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wgfb\" (UniqueName: \"kubernetes.io/projected/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-kube-api-access-4wgfb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.347219 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.347181 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r66z8"] Jul 08 19:05:29.350509 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:05:29.350483 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d8e5161_d3e7_4a3e_b967_072f9e4aa22f.slice/crio-5bc906ba33fe6e1c7904d0f57eb1ad6658861f77d2c5447cf78325c9cf1ffa85 WatchSource:0}: Error finding container 5bc906ba33fe6e1c7904d0f57eb1ad6658861f77d2c5447cf78325c9cf1ffa85: Status 404 returned error can't find the container with id 5bc906ba33fe6e1c7904d0f57eb1ad6658861f77d2c5447cf78325c9cf1ffa85 Jul 08 19:05:29.399153 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.399120 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.399345 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.399174 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.399345 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.399298 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wgfb\" (UniqueName: \"kubernetes.io/projected/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-kube-api-access-4wgfb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.399527 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.399512 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.399567 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.399549 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.408504 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.408478 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wgfb\" (UniqueName: \"kubernetes.io/projected/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-kube-api-access-4wgfb\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.536128 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.536074 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:29.671801 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.671759 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl"] Jul 08 19:05:29.677214 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:05:29.677180 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c70d51b_f0d7_44f2_bce5_03a34185c6f2.slice/crio-b801db3b2926ca4c65ecb172a7f71beee8250fe16edb88a407d8132e6cc353d9 WatchSource:0}: Error finding container b801db3b2926ca4c65ecb172a7f71beee8250fe16edb88a407d8132e6cc353d9: Status 404 returned error can't find the container with id b801db3b2926ca4c65ecb172a7f71beee8250fe16edb88a407d8132e6cc353d9 Jul 08 19:05:29.989129 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.989095 2560 generic.go:356] "Generic (PLEG): container finished" podID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerID="a928e51d298ee5c7675c6be5b366bddad85c2e8537cdd211293a180bad0ccfc6" exitCode=0 Jul 08 19:05:29.989322 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.989182 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" event={"ID":"2c70d51b-f0d7-44f2-bce5-03a34185c6f2","Type":"ContainerDied","Data":"a928e51d298ee5c7675c6be5b366bddad85c2e8537cdd211293a180bad0ccfc6"} Jul 08 19:05:29.989322 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.989233 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" event={"ID":"2c70d51b-f0d7-44f2-bce5-03a34185c6f2","Type":"ContainerStarted","Data":"b801db3b2926ca4c65ecb172a7f71beee8250fe16edb88a407d8132e6cc353d9"} Jul 08 19:05:29.990471 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:29.990445 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" event={"ID":"3d8e5161-d3e7-4a3e-b967-072f9e4aa22f","Type":"ContainerStarted","Data":"5bc906ba33fe6e1c7904d0f57eb1ad6658861f77d2c5447cf78325c9cf1ffa85"} Jul 08 19:05:34.012120 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:34.012084 2560 generic.go:356] "Generic (PLEG): container finished" podID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerID="b8c7551e8e266818defbef751ad02b3f05439ee07d6250f55756d4ad7eca7d0d" exitCode=0 Jul 08 19:05:34.012698 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:34.012173 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" event={"ID":"2c70d51b-f0d7-44f2-bce5-03a34185c6f2","Type":"ContainerDied","Data":"b8c7551e8e266818defbef751ad02b3f05439ee07d6250f55756d4ad7eca7d0d"} Jul 08 19:05:34.013812 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:34.013787 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" event={"ID":"3d8e5161-d3e7-4a3e-b967-072f9e4aa22f","Type":"ContainerStarted","Data":"bf6eb9b541816c2fecc3afa8a58c4706989f368aeca3748aa67b2e0e5faac4f4"} Jul 08 19:05:34.013930 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:34.013848 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:34.055907 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:34.055853 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" podStartSLOduration=2.068544079 podStartE2EDuration="6.055832194s" totalImagesPullingTime="3.987288115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:34.054693468 +0000 UTC m=+232.745684990" watchObservedRunningTime="2026-07-08 19:05:34.055832194 +0000 UTC m=+232.746823716" Jul 08 19:05:35.020524 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.020487 2560 generic.go:356] "Generic (PLEG): container finished" podID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerID="6ed55791dc7dd6d5a880582ff271c9ccd18f31ce7410519151231cf52df58a8b" exitCode=0 Jul 08 19:05:35.020952 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.020587 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" event={"ID":"2c70d51b-f0d7-44f2-bce5-03a34185c6f2","Type":"ContainerDied","Data":"6ed55791dc7dd6d5a880582ff271c9ccd18f31ce7410519151231cf52df58a8b"} Jul 08 19:05:35.262925 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.262884 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xltmc"] Jul 08 19:05:35.266649 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.266630 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" Jul 08 19:05:35.268615 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.268597 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6dljk\"" Jul 08 19:05:35.275800 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.275770 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xltmc"] Jul 08 19:05:35.354042 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.354006 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7980c987-b933-4dc4-ba3a-3cf56f933ab9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xltmc\" (UID: \"7980c987-b933-4dc4-ba3a-3cf56f933ab9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" Jul 08 19:05:35.354042 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.354045 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdxr5\" (UniqueName: \"kubernetes.io/projected/7980c987-b933-4dc4-ba3a-3cf56f933ab9-kube-api-access-rdxr5\") pod \"cert-manager-cainjector-559cdd8c87-xltmc\" (UID: \"7980c987-b933-4dc4-ba3a-3cf56f933ab9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" Jul 08 19:05:35.454906 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.454861 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7980c987-b933-4dc4-ba3a-3cf56f933ab9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xltmc\" (UID: \"7980c987-b933-4dc4-ba3a-3cf56f933ab9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" Jul 08 19:05:35.454906 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.454905 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdxr5\" (UniqueName: \"kubernetes.io/projected/7980c987-b933-4dc4-ba3a-3cf56f933ab9-kube-api-access-rdxr5\") pod \"cert-manager-cainjector-559cdd8c87-xltmc\" (UID: \"7980c987-b933-4dc4-ba3a-3cf56f933ab9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" Jul 08 19:05:35.463368 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.463346 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7980c987-b933-4dc4-ba3a-3cf56f933ab9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xltmc\" (UID: \"7980c987-b933-4dc4-ba3a-3cf56f933ab9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" Jul 08 19:05:35.463551 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.463533 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdxr5\" (UniqueName: \"kubernetes.io/projected/7980c987-b933-4dc4-ba3a-3cf56f933ab9-kube-api-access-rdxr5\") pod \"cert-manager-cainjector-559cdd8c87-xltmc\" (UID: \"7980c987-b933-4dc4-ba3a-3cf56f933ab9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" Jul 08 19:05:35.576357 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.576242 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" Jul 08 19:05:35.712310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:35.712272 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xltmc"] Jul 08 19:05:35.715439 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:05:35.715411 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7980c987_b933_4dc4_ba3a_3cf56f933ab9.slice/crio-9ed25f21ac0eaba96f88a7ba37a902e7e1caa39b1cdded34e508a08e4b013c12 WatchSource:0}: Error finding container 9ed25f21ac0eaba96f88a7ba37a902e7e1caa39b1cdded34e508a08e4b013c12: Status 404 returned error can't find the container with id 9ed25f21ac0eaba96f88a7ba37a902e7e1caa39b1cdded34e508a08e4b013c12 Jul 08 19:05:36.028081 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.028043 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" event={"ID":"7980c987-b933-4dc4-ba3a-3cf56f933ab9","Type":"ContainerStarted","Data":"d7957201102d8e2a463eb5a06cd5f2d0dd8a88d26f889c8cfa9c2f03276a71bb"} Jul 08 19:05:36.028556 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.028095 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" event={"ID":"7980c987-b933-4dc4-ba3a-3cf56f933ab9","Type":"ContainerStarted","Data":"9ed25f21ac0eaba96f88a7ba37a902e7e1caa39b1cdded34e508a08e4b013c12"} Jul 08 19:05:36.044854 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.044801 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xltmc" podStartSLOduration=1.044780764 podStartE2EDuration="1.044780764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:36.043203165 +0000 UTC m=+234.734194688" watchObservedRunningTime="2026-07-08 19:05:36.044780764 +0000 UTC m=+234.735772288" Jul 08 19:05:36.161917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.161892 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:36.262471 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.262437 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-util\") pod \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " Jul 08 19:05:36.262661 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.262494 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-bundle\") pod \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " Jul 08 19:05:36.262661 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.262552 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wgfb\" (UniqueName: \"kubernetes.io/projected/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-kube-api-access-4wgfb\") pod \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\" (UID: \"2c70d51b-f0d7-44f2-bce5-03a34185c6f2\") " Jul 08 19:05:36.262947 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.262897 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-bundle" (OuterVolumeSpecName: "bundle") pod "2c70d51b-f0d7-44f2-bce5-03a34185c6f2" (UID: "2c70d51b-f0d7-44f2-bce5-03a34185c6f2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:36.264924 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.264898 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-kube-api-access-4wgfb" (OuterVolumeSpecName: "kube-api-access-4wgfb") pod "2c70d51b-f0d7-44f2-bce5-03a34185c6f2" (UID: "2c70d51b-f0d7-44f2-bce5-03a34185c6f2"). InnerVolumeSpecName "kube-api-access-4wgfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:05:36.267082 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.267056 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-util" (OuterVolumeSpecName: "util") pod "2c70d51b-f0d7-44f2-bce5-03a34185c6f2" (UID: "2c70d51b-f0d7-44f2-bce5-03a34185c6f2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:36.363408 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.363312 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-util\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:05:36.363408 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.363340 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:05:36.363408 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:36.363350 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wgfb\" (UniqueName: \"kubernetes.io/projected/2c70d51b-f0d7-44f2-bce5-03a34185c6f2-kube-api-access-4wgfb\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:05:37.034064 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:37.034038 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" Jul 08 19:05:37.034497 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:37.034070 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnv9zl" event={"ID":"2c70d51b-f0d7-44f2-bce5-03a34185c6f2","Type":"ContainerDied","Data":"b801db3b2926ca4c65ecb172a7f71beee8250fe16edb88a407d8132e6cc353d9"} Jul 08 19:05:37.034497 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:37.034131 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b801db3b2926ca4c65ecb172a7f71beee8250fe16edb88a407d8132e6cc353d9" Jul 08 19:05:40.023202 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:40.023170 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r66z8" Jul 08 19:05:41.400725 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.400684 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xfxwc"] Jul 08 19:05:41.401114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.400989 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerName="extract" Jul 08 19:05:41.401114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.401001 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerName="extract" Jul 08 19:05:41.401114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.401023 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerName="util" Jul 08 19:05:41.401114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.401029 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerName="util" Jul 08 19:05:41.401114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.401036 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerName="pull" Jul 08 19:05:41.401114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.401040 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerName="pull" Jul 08 19:05:41.401114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.401088 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c70d51b-f0d7-44f2-bce5-03a34185c6f2" containerName="extract" Jul 08 19:05:41.403123 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.403108 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xfxwc" Jul 08 19:05:41.405239 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.405222 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9k9sr\"" Jul 08 19:05:41.417860 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.417834 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xfxwc"] Jul 08 19:05:41.512590 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.512554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eed5724d-fea4-44ec-a85f-2f5428e3b662-bound-sa-token\") pod \"cert-manager-55b4d954d5-xfxwc\" (UID: \"eed5724d-fea4-44ec-a85f-2f5428e3b662\") " pod="cert-manager/cert-manager-55b4d954d5-xfxwc" Jul 08 19:05:41.512788 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.512634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w2pc\" (UniqueName: \"kubernetes.io/projected/eed5724d-fea4-44ec-a85f-2f5428e3b662-kube-api-access-9w2pc\") pod \"cert-manager-55b4d954d5-xfxwc\" (UID: \"eed5724d-fea4-44ec-a85f-2f5428e3b662\") " pod="cert-manager/cert-manager-55b4d954d5-xfxwc" Jul 08 19:05:41.614050 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.614016 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w2pc\" (UniqueName: \"kubernetes.io/projected/eed5724d-fea4-44ec-a85f-2f5428e3b662-kube-api-access-9w2pc\") pod \"cert-manager-55b4d954d5-xfxwc\" (UID: \"eed5724d-fea4-44ec-a85f-2f5428e3b662\") " pod="cert-manager/cert-manager-55b4d954d5-xfxwc" Jul 08 19:05:41.614220 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.614085 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eed5724d-fea4-44ec-a85f-2f5428e3b662-bound-sa-token\") pod \"cert-manager-55b4d954d5-xfxwc\" (UID: \"eed5724d-fea4-44ec-a85f-2f5428e3b662\") " pod="cert-manager/cert-manager-55b4d954d5-xfxwc" Jul 08 19:05:41.622877 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.622846 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eed5724d-fea4-44ec-a85f-2f5428e3b662-bound-sa-token\") pod \"cert-manager-55b4d954d5-xfxwc\" (UID: \"eed5724d-fea4-44ec-a85f-2f5428e3b662\") " pod="cert-manager/cert-manager-55b4d954d5-xfxwc" Jul 08 19:05:41.623000 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.622921 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w2pc\" (UniqueName: \"kubernetes.io/projected/eed5724d-fea4-44ec-a85f-2f5428e3b662-kube-api-access-9w2pc\") pod \"cert-manager-55b4d954d5-xfxwc\" (UID: \"eed5724d-fea4-44ec-a85f-2f5428e3b662\") " pod="cert-manager/cert-manager-55b4d954d5-xfxwc" Jul 08 19:05:41.714753 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.714673 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9k9sr\"" Jul 08 19:05:41.723165 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.723143 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xfxwc" Jul 08 19:05:41.872306 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:41.872272 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xfxwc"] Jul 08 19:05:41.875227 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:05:41.875200 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeed5724d_fea4_44ec_a85f_2f5428e3b662.slice/crio-f8a302ac05f8382ff6f31cb096d1fbb89af576729c20eab6dd1aca9ad557ef52 WatchSource:0}: Error finding container f8a302ac05f8382ff6f31cb096d1fbb89af576729c20eab6dd1aca9ad557ef52: Status 404 returned error can't find the container with id f8a302ac05f8382ff6f31cb096d1fbb89af576729c20eab6dd1aca9ad557ef52 Jul 08 19:05:42.057633 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:42.057593 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xfxwc" event={"ID":"eed5724d-fea4-44ec-a85f-2f5428e3b662","Type":"ContainerStarted","Data":"8840d97b47cb75b80eaa487b0cfffee7f13e9d5d75fc5e8f5f1858517e7a6035"} Jul 08 19:05:42.057797 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:42.057643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xfxwc" event={"ID":"eed5724d-fea4-44ec-a85f-2f5428e3b662","Type":"ContainerStarted","Data":"f8a302ac05f8382ff6f31cb096d1fbb89af576729c20eab6dd1aca9ad557ef52"} Jul 08 19:05:42.073565 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:42.073508 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xfxwc" podStartSLOduration=1.073491593 podStartE2EDuration="1.073491593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:42.072805104 +0000 UTC m=+240.763796626" watchObservedRunningTime="2026-07-08 19:05:42.073491593 +0000 UTC m=+240.764483117" Jul 08 19:05:47.821715 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:47.821679 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw"] Jul 08 19:05:47.825446 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:47.825425 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" Jul 08 19:05:47.827516 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:47.827490 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 19:05:47.827683 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:47.827536 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 19:05:47.827832 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:47.827819 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-f6g4c\"" Jul 08 19:05:47.831961 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:47.831889 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw"] Jul 08 19:05:47.969187 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:47.969153 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/965eb4fe-6e45-40b7-b04e-e4d23ca48bed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2vvlw\" (UID: \"965eb4fe-6e45-40b7-b04e-e4d23ca48bed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" Jul 08 19:05:47.969187 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:47.969186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7vr5\" (UniqueName: \"kubernetes.io/projected/965eb4fe-6e45-40b7-b04e-e4d23ca48bed-kube-api-access-n7vr5\") pod \"openshift-lws-operator-fd8ccff4c-2vvlw\" (UID: \"965eb4fe-6e45-40b7-b04e-e4d23ca48bed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" Jul 08 19:05:48.069877 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:48.069843 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/965eb4fe-6e45-40b7-b04e-e4d23ca48bed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2vvlw\" (UID: \"965eb4fe-6e45-40b7-b04e-e4d23ca48bed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" Jul 08 19:05:48.069877 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:48.069874 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vr5\" (UniqueName: \"kubernetes.io/projected/965eb4fe-6e45-40b7-b04e-e4d23ca48bed-kube-api-access-n7vr5\") pod \"openshift-lws-operator-fd8ccff4c-2vvlw\" (UID: \"965eb4fe-6e45-40b7-b04e-e4d23ca48bed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" Jul 08 19:05:48.070423 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:48.070282 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/965eb4fe-6e45-40b7-b04e-e4d23ca48bed-tmp\") pod \"openshift-lws-operator-fd8ccff4c-2vvlw\" (UID: \"965eb4fe-6e45-40b7-b04e-e4d23ca48bed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" Jul 08 19:05:48.079730 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:48.079668 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vr5\" (UniqueName: \"kubernetes.io/projected/965eb4fe-6e45-40b7-b04e-e4d23ca48bed-kube-api-access-n7vr5\") pod \"openshift-lws-operator-fd8ccff4c-2vvlw\" (UID: \"965eb4fe-6e45-40b7-b04e-e4d23ca48bed\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" Jul 08 19:05:48.136158 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:48.136117 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" Jul 08 19:05:48.278741 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:48.278594 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw"] Jul 08 19:05:48.285852 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:05:48.285820 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod965eb4fe_6e45_40b7_b04e_e4d23ca48bed.slice/crio-534fe1a030cb758c53368e471f363369736d25c4f3e9221ae8a1e17b5b6d4e55 WatchSource:0}: Error finding container 534fe1a030cb758c53368e471f363369736d25c4f3e9221ae8a1e17b5b6d4e55: Status 404 returned error can't find the container with id 534fe1a030cb758c53368e471f363369736d25c4f3e9221ae8a1e17b5b6d4e55 Jul 08 19:05:49.092134 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:49.092092 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" event={"ID":"965eb4fe-6e45-40b7-b04e-e4d23ca48bed","Type":"ContainerStarted","Data":"534fe1a030cb758c53368e471f363369736d25c4f3e9221ae8a1e17b5b6d4e55"} Jul 08 19:05:51.103931 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:51.103875 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" event={"ID":"965eb4fe-6e45-40b7-b04e-e4d23ca48bed","Type":"ContainerStarted","Data":"0c7d0c96a21decd198b3a727079f5e8756efba3da20dbb11ba01cd274233be54"} Jul 08 19:05:51.120740 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:51.120630 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-2vvlw" podStartSLOduration=1.928299233 podStartE2EDuration="4.120608594s" totalImagesPullingTime="2.192309361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:05:51.120226282 +0000 UTC m=+249.811217816" watchObservedRunningTime="2026-07-08 19:05:51.120608594 +0000 UTC m=+249.811600116" Jul 08 19:05:55.254405 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.254357 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6"] Jul 08 19:05:55.262918 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.262884 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.264981 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.264951 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 19:05:55.265139 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.264956 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qp66r\"" Jul 08 19:05:55.265309 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.265290 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 19:05:55.266597 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.266566 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6"] Jul 08 19:05:55.333478 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.333444 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.333478 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.333486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4mg\" (UniqueName: \"kubernetes.io/projected/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-kube-api-access-zv4mg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.333696 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.333558 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.434307 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.434267 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4mg\" (UniqueName: \"kubernetes.io/projected/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-kube-api-access-zv4mg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.434511 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.434322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.434511 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.434407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.434763 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.434740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.434804 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.434748 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.442771 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.442742 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4mg\" (UniqueName: \"kubernetes.io/projected/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-kube-api-access-zv4mg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.574372 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.574283 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:55.710425 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:55.710378 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6"] Jul 08 19:05:55.712844 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:05:55.712812 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025dbcf9_6e09_48c9_a6d1_a45ee434ee6d.slice/crio-bca69e38b179bc51a6fccf750773424492b1cf3d4a5966e84f73c7092adc0980 WatchSource:0}: Error finding container bca69e38b179bc51a6fccf750773424492b1cf3d4a5966e84f73c7092adc0980: Status 404 returned error can't find the container with id bca69e38b179bc51a6fccf750773424492b1cf3d4a5966e84f73c7092adc0980 Jul 08 19:05:56.127514 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:56.127474 2560 generic.go:356] "Generic (PLEG): container finished" podID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerID="99e01682688c2442bf83ae573f41b654ae265aad1befa4a5bd26b9c5c036b27f" exitCode=0 Jul 08 19:05:56.127706 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:56.127567 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" event={"ID":"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d","Type":"ContainerDied","Data":"99e01682688c2442bf83ae573f41b654ae265aad1befa4a5bd26b9c5c036b27f"} Jul 08 19:05:56.127706 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:56.127626 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" event={"ID":"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d","Type":"ContainerStarted","Data":"bca69e38b179bc51a6fccf750773424492b1cf3d4a5966e84f73c7092adc0980"} Jul 08 19:05:57.134528 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:57.134498 2560 generic.go:356] "Generic (PLEG): container finished" podID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerID="22ce2d697ef6621d8ac83aa7e95f8f310b5f6f7f496674af6f9cb45d14062564" exitCode=0 Jul 08 19:05:57.134897 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:57.134593 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" event={"ID":"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d","Type":"ContainerDied","Data":"22ce2d697ef6621d8ac83aa7e95f8f310b5f6f7f496674af6f9cb45d14062564"} Jul 08 19:05:58.141021 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:58.140984 2560 generic.go:356] "Generic (PLEG): container finished" podID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerID="b058a730a3a30a01412aeba1a2f20900a9d7d659cf1af540e7e4f09011ddca65" exitCode=0 Jul 08 19:05:58.141412 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:58.141066 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" event={"ID":"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d","Type":"ContainerDied","Data":"b058a730a3a30a01412aeba1a2f20900a9d7d659cf1af540e7e4f09011ddca65"} Jul 08 19:05:59.281023 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.280992 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:05:59.369049 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.369011 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-util\") pod \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " Jul 08 19:05:59.369049 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.369059 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv4mg\" (UniqueName: \"kubernetes.io/projected/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-kube-api-access-zv4mg\") pod \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " Jul 08 19:05:59.369272 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.369117 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-bundle\") pod \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\" (UID: \"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d\") " Jul 08 19:05:59.370065 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.370032 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-bundle" (OuterVolumeSpecName: "bundle") pod "025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" (UID: "025dbcf9-6e09-48c9-a6d1-a45ee434ee6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:59.371406 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.371365 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-kube-api-access-zv4mg" (OuterVolumeSpecName: "kube-api-access-zv4mg") pod "025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" (UID: "025dbcf9-6e09-48c9-a6d1-a45ee434ee6d"). InnerVolumeSpecName "kube-api-access-zv4mg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:05:59.375129 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.375106 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-util" (OuterVolumeSpecName: "util") pod "025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" (UID: "025dbcf9-6e09-48c9-a6d1-a45ee434ee6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:05:59.469723 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.469692 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-util\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:05:59.469723 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.469722 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv4mg\" (UniqueName: \"kubernetes.io/projected/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-kube-api-access-zv4mg\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:05:59.469914 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:05:59.469734 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/025dbcf9-6e09-48c9-a6d1-a45ee434ee6d-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:06:00.151980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:00.151943 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" event={"ID":"025dbcf9-6e09-48c9-a6d1-a45ee434ee6d","Type":"ContainerDied","Data":"bca69e38b179bc51a6fccf750773424492b1cf3d4a5966e84f73c7092adc0980"} Jul 08 19:06:00.151980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:00.151972 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afztcb6" Jul 08 19:06:00.152155 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:00.152017 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bca69e38b179bc51a6fccf750773424492b1cf3d4a5966e84f73c7092adc0980" Jul 08 19:06:04.371773 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.371684 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw"] Jul 08 19:06:04.372281 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.372166 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerName="pull" Jul 08 19:06:04.372281 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.372184 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerName="pull" Jul 08 19:06:04.372281 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.372199 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerName="extract" Jul 08 19:06:04.372281 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.372207 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerName="extract" Jul 08 19:06:04.372281 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.372240 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerName="util" Jul 08 19:06:04.372281 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.372248 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerName="util" Jul 08 19:06:04.372602 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.372330 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="025dbcf9-6e09-48c9-a6d1-a45ee434ee6d" containerName="extract" Jul 08 19:06:04.374328 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.374308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.376765 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.376747 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 19:06:04.377137 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.377100 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 19:06:04.377242 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.377159 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qqjrz\"" Jul 08 19:06:04.377416 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.377371 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 19:06:04.384913 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.384889 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw"] Jul 08 19:06:04.512463 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.512423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d59111b1-53fb-416c-b353-6ac955026418-metrics-cert\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.512644 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.512535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d59111b1-53fb-416c-b353-6ac955026418-manager-config\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.512644 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.512583 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh54l\" (UniqueName: \"kubernetes.io/projected/d59111b1-53fb-416c-b353-6ac955026418-kube-api-access-qh54l\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.512644 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.512607 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d59111b1-53fb-416c-b353-6ac955026418-cert\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.613783 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.613738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d59111b1-53fb-416c-b353-6ac955026418-metrics-cert\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.613992 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.613814 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d59111b1-53fb-416c-b353-6ac955026418-manager-config\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.613992 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.613833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh54l\" (UniqueName: \"kubernetes.io/projected/d59111b1-53fb-416c-b353-6ac955026418-kube-api-access-qh54l\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.613992 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.613854 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d59111b1-53fb-416c-b353-6ac955026418-cert\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.614565 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.614538 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d59111b1-53fb-416c-b353-6ac955026418-manager-config\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.616608 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.616584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d59111b1-53fb-416c-b353-6ac955026418-cert\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.616687 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.616626 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d59111b1-53fb-416c-b353-6ac955026418-metrics-cert\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.631091 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.631026 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh54l\" (UniqueName: \"kubernetes.io/projected/d59111b1-53fb-416c-b353-6ac955026418-kube-api-access-qh54l\") pod \"lws-controller-manager-ff8fc7d87-md9sw\" (UID: \"d59111b1-53fb-416c-b353-6ac955026418\") " pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.685210 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.685178 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:04.832570 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:04.832538 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw"] Jul 08 19:06:04.835155 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:06:04.835119 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd59111b1_53fb_416c_b353_6ac955026418.slice/crio-b556d0ba3baba7876cdbd1d3879557c7052e1eddb7dd448fdd9f071e2941404e WatchSource:0}: Error finding container b556d0ba3baba7876cdbd1d3879557c7052e1eddb7dd448fdd9f071e2941404e: Status 404 returned error can't find the container with id b556d0ba3baba7876cdbd1d3879557c7052e1eddb7dd448fdd9f071e2941404e Jul 08 19:06:05.175795 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:05.175752 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" event={"ID":"d59111b1-53fb-416c-b353-6ac955026418","Type":"ContainerStarted","Data":"b556d0ba3baba7876cdbd1d3879557c7052e1eddb7dd448fdd9f071e2941404e"} Jul 08 19:06:06.773554 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.773519 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96"] Jul 08 19:06:06.776277 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.776260 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:06.778977 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.778947 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 19:06:06.779107 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.778984 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 19:06:06.779107 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.779075 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-np4sl\"" Jul 08 19:06:06.779294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.779278 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 19:06:06.779352 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.779299 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 19:06:06.793124 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.793094 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96"] Jul 08 19:06:06.934691 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.934652 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:06.934897 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.934699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:06.934897 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.934761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:06.934897 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.934855 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2clgw\" (UniqueName: \"kubernetes.io/projected/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-kube-api-access-2clgw\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:06.934897 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:06.934889 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.035910 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.035805 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2clgw\" (UniqueName: \"kubernetes.io/projected/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-kube-api-access-2clgw\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.035910 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.035855 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.035910 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.035900 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.036229 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.035917 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.036229 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.035944 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.036332 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.036266 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-manifests\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.038532 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.038501 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-tmp\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.038754 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.038736 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.038794 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.038764 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-webhook-cert\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.044900 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.044875 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2clgw\" (UniqueName: \"kubernetes.io/projected/2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09-kube-api-access-2clgw\") pod \"opendatahub-operator-controller-manager-9dc45487-l9q96\" (UID: \"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09\") " pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.087673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.087632 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:07.189036 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.188998 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" event={"ID":"d59111b1-53fb-416c-b353-6ac955026418","Type":"ContainerStarted","Data":"7620d753ad28df9cc4663376439a96d9a2996646b78cbb39c783e14122c2dd81"} Jul 08 19:06:07.189273 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.189221 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:07.208174 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.208122 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" podStartSLOduration=1.6409466510000001 podStartE2EDuration="3.208104486s" totalImagesPullingTime="1.567157835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:07.206465652 +0000 UTC m=+265.897457176" watchObservedRunningTime="2026-07-08 19:06:07.208104486 +0000 UTC m=+265.899096008" Jul 08 19:06:07.238507 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:07.238478 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96"] Jul 08 19:06:07.241027 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:06:07.240997 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5e7d1a_91ed_4cf5_b500_6e53a78b9d09.slice/crio-e43f923dee0dc15c4e789060d8048a8c3c3ef30165867ab51cc5c521712c048d WatchSource:0}: Error finding container e43f923dee0dc15c4e789060d8048a8c3c3ef30165867ab51cc5c521712c048d: Status 404 returned error can't find the container with id e43f923dee0dc15c4e789060d8048a8c3c3ef30165867ab51cc5c521712c048d Jul 08 19:06:08.197026 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:08.196984 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" event={"ID":"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09","Type":"ContainerStarted","Data":"e43f923dee0dc15c4e789060d8048a8c3c3ef30165867ab51cc5c521712c048d"} Jul 08 19:06:11.214419 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:11.214328 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" event={"ID":"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09","Type":"ContainerStarted","Data":"bcb49eb032eb77ecf33dd6e323380ca028f5402f85b379382e5c84d65b700d7a"} Jul 08 19:06:12.220902 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:12.220868 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09" containerID="bcb49eb032eb77ecf33dd6e323380ca028f5402f85b379382e5c84d65b700d7a" exitCode=0 Jul 08 19:06:12.221300 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:12.220908 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" event={"ID":"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09","Type":"ContainerDied","Data":"bcb49eb032eb77ecf33dd6e323380ca028f5402f85b379382e5c84d65b700d7a"} Jul 08 19:06:13.228187 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:13.228152 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" event={"ID":"2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09","Type":"ContainerStarted","Data":"a9857b81eeba7b32425cd52f1303ac49eeb3cc21ff272f7c295b0a99b2132bad"} Jul 08 19:06:13.228695 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:13.228251 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:13.248901 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:13.248843 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" podStartSLOduration=2.842806769 podStartE2EDuration="7.24882292s" totalImagesPullingTime="3.343979435s" totalInitContainerRuntime="1.062036716s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:13.247732962 +0000 UTC m=+271.938724503" watchObservedRunningTime="2026-07-08 19:06:13.24882292 +0000 UTC m=+271.939814442" Jul 08 19:06:18.199885 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:18.199853 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-ff8fc7d87-md9sw" Jul 08 19:06:24.235171 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:24.235138 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9dc45487-l9q96" Jul 08 19:06:33.694927 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.694886 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8"] Jul 08 19:06:33.698695 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.698668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.700593 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.700568 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 19:06:33.700742 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.700655 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 19:06:33.700742 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.700720 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 19:06:33.700856 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.700816 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-q79pb\"" Jul 08 19:06:33.700927 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.700909 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 19:06:33.701078 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.701062 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 19:06:33.701162 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.701062 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 19:06:33.711432 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.711409 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8"] Jul 08 19:06:33.768999 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.768963 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.768999 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.768999 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.769216 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.769029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.769216 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.769095 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.769216 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.769133 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz68p\" (UniqueName: \"kubernetes.io/projected/369a4f7c-112c-448f-ba73-f7a26b81a3f3-kube-api-access-qz68p\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.769216 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.769174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/369a4f7c-112c-448f-ba73-f7a26b81a3f3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.769337 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.769246 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.870017 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.869981 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.870017 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.870022 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz68p\" (UniqueName: \"kubernetes.io/projected/369a4f7c-112c-448f-ba73-f7a26b81a3f3-kube-api-access-qz68p\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.870272 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.870163 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/369a4f7c-112c-448f-ba73-f7a26b81a3f3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.870272 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.870245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.870401 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.870298 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.870401 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.870338 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.870513 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.870424 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.871013 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.870975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.872845 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.872823 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.872936 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.872838 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.872976 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.872959 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/369a4f7c-112c-448f-ba73-f7a26b81a3f3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.872976 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.872971 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.878878 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.878858 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz68p\" (UniqueName: \"kubernetes.io/projected/369a4f7c-112c-448f-ba73-f7a26b81a3f3-kube-api-access-qz68p\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:33.879116 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:33.879096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/369a4f7c-112c-448f-ba73-f7a26b81a3f3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-85nc8\" (UID: \"369a4f7c-112c-448f-ba73-f7a26b81a3f3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:34.008641 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:34.008602 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:34.163206 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:34.163171 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8"] Jul 08 19:06:34.165843 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:06:34.165815 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369a4f7c_112c_448f_ba73_f7a26b81a3f3.slice/crio-4d7b36349eca64fa300b695f7e07d495eed28e20a1de9488831d5556c6f1fc72 WatchSource:0}: Error finding container 4d7b36349eca64fa300b695f7e07d495eed28e20a1de9488831d5556c6f1fc72: Status 404 returned error can't find the container with id 4d7b36349eca64fa300b695f7e07d495eed28e20a1de9488831d5556c6f1fc72 Jul 08 19:06:34.329881 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:34.329788 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" event={"ID":"369a4f7c-112c-448f-ba73-f7a26b81a3f3","Type":"ContainerStarted","Data":"4d7b36349eca64fa300b695f7e07d495eed28e20a1de9488831d5556c6f1fc72"} Jul 08 19:06:36.311229 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:36.311191 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:06:36.311561 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:36.311260 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 08 19:06:37.347813 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:37.347762 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" event={"ID":"369a4f7c-112c-448f-ba73-f7a26b81a3f3","Type":"ContainerStarted","Data":"adf1e2cc2d5ba82e3f50ccd8908d663eb49282c83be37fa26328f720c0ba356b"} Jul 08 19:06:37.348258 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:37.347888 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:37.349571 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:37.349542 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" Jul 08 19:06:37.405482 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:37.405419 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-85nc8" podStartSLOduration=2.262225322 podStartE2EDuration="4.405403142s" totalImagesPullingTime="2.14317782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:06:37.380939788 +0000 UTC m=+296.071931312" watchObservedRunningTime="2026-07-08 19:06:37.405403142 +0000 UTC m=+296.096394656" Jul 08 19:06:41.745207 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:06:41.745177 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 19:07:42.837461 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.837331 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk"] Jul 08 19:07:42.841186 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.841161 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:42.843560 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.843534 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:07:42.843706 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.843564 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:07:42.843706 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.843622 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c8qc2\"" Jul 08 19:07:42.849933 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.849905 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk"] Jul 08 19:07:42.992796 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.992751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:42.992796 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.992794 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfcqk\" (UniqueName: \"kubernetes.io/projected/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-kube-api-access-wfcqk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:42.993041 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:42.992821 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:43.093881 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.093783 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:43.093881 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.093826 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfcqk\" (UniqueName: \"kubernetes.io/projected/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-kube-api-access-wfcqk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:43.094081 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.093958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:43.094229 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.094212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:43.094278 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.094259 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:43.103054 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.103020 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfcqk\" (UniqueName: \"kubernetes.io/projected/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-kube-api-access-wfcqk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:43.151306 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.151265 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:43.296998 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.296969 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk"] Jul 08 19:07:43.299109 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:07:43.299083 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb90f18_54e2_44ae_b754_ad1f817f3c6a.slice/crio-a33660dbb8a1517336df15dd69890dd36120849fb0f3df539cf0057d9a791063 WatchSource:0}: Error finding container a33660dbb8a1517336df15dd69890dd36120849fb0f3df539cf0057d9a791063: Status 404 returned error can't find the container with id a33660dbb8a1517336df15dd69890dd36120849fb0f3df539cf0057d9a791063 Jul 08 19:07:43.461915 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.461875 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r"] Jul 08 19:07:43.465231 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.465214 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.477064 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.477034 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r"] Jul 08 19:07:43.599572 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.599466 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.599572 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.599542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.599572 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.599572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf678\" (UniqueName: \"kubernetes.io/projected/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-kube-api-access-pf678\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.665316 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.665274 2560 generic.go:356] "Generic (PLEG): container finished" podID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerID="bef2bdb2e4cdd706d1158b5a4c099fced4f4307865bf7da791f97d6ff07a8f25" exitCode=0 Jul 08 19:07:43.665507 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.665362 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" event={"ID":"eeb90f18-54e2-44ae-b754-ad1f817f3c6a","Type":"ContainerDied","Data":"bef2bdb2e4cdd706d1158b5a4c099fced4f4307865bf7da791f97d6ff07a8f25"} Jul 08 19:07:43.665507 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.665438 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" event={"ID":"eeb90f18-54e2-44ae-b754-ad1f817f3c6a","Type":"ContainerStarted","Data":"a33660dbb8a1517336df15dd69890dd36120849fb0f3df539cf0057d9a791063"} Jul 08 19:07:43.665926 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.665912 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:07:43.701149 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.701109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.701341 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.701158 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.701341 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.701183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf678\" (UniqueName: \"kubernetes.io/projected/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-kube-api-access-pf678\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.701546 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.701527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.701609 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.701589 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.713470 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.713436 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf678\" (UniqueName: \"kubernetes.io/projected/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-kube-api-access-pf678\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.775340 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.775298 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:43.921087 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:43.921060 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r"] Jul 08 19:07:43.923687 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:07:43.923665 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57e3bf8_8672_4057_b1a6_f56f6b8b0d9d.slice/crio-89ea808375950ef0793969950bbeb07d1b07560ad34b0f2660da2759727c0543 WatchSource:0}: Error finding container 89ea808375950ef0793969950bbeb07d1b07560ad34b0f2660da2759727c0543: Status 404 returned error can't find the container with id 89ea808375950ef0793969950bbeb07d1b07560ad34b0f2660da2759727c0543 Jul 08 19:07:44.043943 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.043910 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl"] Jul 08 19:07:44.050486 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.048658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.056973 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.056940 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl"] Jul 08 19:07:44.206368 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.206330 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.206368 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.206374 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.206648 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.206526 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvs6q\" (UniqueName: \"kubernetes.io/projected/367f68f0-bb95-4ba6-8548-2087c768ca21-kube-api-access-qvs6q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.307571 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.307528 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.307571 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.307574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.307879 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.307640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvs6q\" (UniqueName: \"kubernetes.io/projected/367f68f0-bb95-4ba6-8548-2087c768ca21-kube-api-access-qvs6q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.307975 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.307953 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.308052 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.308029 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.318248 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.318220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvs6q\" (UniqueName: \"kubernetes.io/projected/367f68f0-bb95-4ba6-8548-2087c768ca21-kube-api-access-qvs6q\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.389177 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.389080 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:44.439831 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.439792 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92"] Jul 08 19:07:44.444321 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.444294 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.455252 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.455217 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92"] Jul 08 19:07:44.549922 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.549891 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl"] Jul 08 19:07:44.552561 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:07:44.552525 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367f68f0_bb95_4ba6_8548_2087c768ca21.slice/crio-19aec42137dd3f17391cb27528f0af7ccc961c3322d5f806f04b2c3884aedf6e WatchSource:0}: Error finding container 19aec42137dd3f17391cb27528f0af7ccc961c3322d5f806f04b2c3884aedf6e: Status 404 returned error can't find the container with id 19aec42137dd3f17391cb27528f0af7ccc961c3322d5f806f04b2c3884aedf6e Jul 08 19:07:44.610221 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.610188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.610532 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.610236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5b62\" (UniqueName: \"kubernetes.io/projected/afc71143-44f8-4192-b1e8-b46f172f070f-kube-api-access-h5b62\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.610532 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.610318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.673773 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.673737 2560 generic.go:356] "Generic (PLEG): container finished" podID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerID="1a6248211353c311ae78b3ae07d40df9d80ee7dea2c966af1a385521115edc30" exitCode=0 Jul 08 19:07:44.673969 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.673823 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" event={"ID":"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d","Type":"ContainerDied","Data":"1a6248211353c311ae78b3ae07d40df9d80ee7dea2c966af1a385521115edc30"} Jul 08 19:07:44.673969 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.673883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" event={"ID":"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d","Type":"ContainerStarted","Data":"89ea808375950ef0793969950bbeb07d1b07560ad34b0f2660da2759727c0543"} Jul 08 19:07:44.675670 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.675640 2560 generic.go:356] "Generic (PLEG): container finished" podID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerID="f5974a28662fce8812231a55d03452c84b954f1660b905786e50880a7cc323d3" exitCode=0 Jul 08 19:07:44.675775 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.675734 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" event={"ID":"367f68f0-bb95-4ba6-8548-2087c768ca21","Type":"ContainerDied","Data":"f5974a28662fce8812231a55d03452c84b954f1660b905786e50880a7cc323d3"} Jul 08 19:07:44.675826 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.675784 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" event={"ID":"367f68f0-bb95-4ba6-8548-2087c768ca21","Type":"ContainerStarted","Data":"19aec42137dd3f17391cb27528f0af7ccc961c3322d5f806f04b2c3884aedf6e"} Jul 08 19:07:44.711047 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.711012 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.711230 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.711117 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.711230 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.711148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5b62\" (UniqueName: \"kubernetes.io/projected/afc71143-44f8-4192-b1e8-b46f172f070f-kube-api-access-h5b62\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.711466 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.711441 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.711556 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.711533 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.720767 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.720699 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5b62\" (UniqueName: \"kubernetes.io/projected/afc71143-44f8-4192-b1e8-b46f172f070f-kube-api-access-h5b62\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.759751 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.759714 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:44.923082 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:44.923051 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92"] Jul 08 19:07:44.925736 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:07:44.925707 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafc71143_44f8_4192_b1e8_b46f172f070f.slice/crio-4f5652b0684b5df50dcdd97731ed5a60fd64e59f99c78f418384f39384207f86 WatchSource:0}: Error finding container 4f5652b0684b5df50dcdd97731ed5a60fd64e59f99c78f418384f39384207f86: Status 404 returned error can't find the container with id 4f5652b0684b5df50dcdd97731ed5a60fd64e59f99c78f418384f39384207f86 Jul 08 19:07:45.682119 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:45.682080 2560 generic.go:356] "Generic (PLEG): container finished" podID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerID="c186b2b23eccfdbb4662c0be482d13e6ad4e6e7d7154bcc8e0f6be12ca8077ca" exitCode=0 Jul 08 19:07:45.682289 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:45.682170 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" event={"ID":"eeb90f18-54e2-44ae-b754-ad1f817f3c6a","Type":"ContainerDied","Data":"c186b2b23eccfdbb4662c0be482d13e6ad4e6e7d7154bcc8e0f6be12ca8077ca"} Jul 08 19:07:45.683797 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:45.683755 2560 generic.go:356] "Generic (PLEG): container finished" podID="afc71143-44f8-4192-b1e8-b46f172f070f" containerID="b7183079f1d333825c59b83d98f0b49fb676213e6f8f573bb1e40c83f0eef709" exitCode=0 Jul 08 19:07:45.683915 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:45.683843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" event={"ID":"afc71143-44f8-4192-b1e8-b46f172f070f","Type":"ContainerDied","Data":"b7183079f1d333825c59b83d98f0b49fb676213e6f8f573bb1e40c83f0eef709"} Jul 08 19:07:45.683915 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:45.683894 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" event={"ID":"afc71143-44f8-4192-b1e8-b46f172f070f","Type":"ContainerStarted","Data":"4f5652b0684b5df50dcdd97731ed5a60fd64e59f99c78f418384f39384207f86"} Jul 08 19:07:46.691754 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:46.691714 2560 generic.go:356] "Generic (PLEG): container finished" podID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerID="ecb466d937a5af07727f2b6130c5306b6dab43c22ae48a18fde9d42664c6593b" exitCode=0 Jul 08 19:07:46.692194 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:46.691794 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" event={"ID":"eeb90f18-54e2-44ae-b754-ad1f817f3c6a","Type":"ContainerDied","Data":"ecb466d937a5af07727f2b6130c5306b6dab43c22ae48a18fde9d42664c6593b"} Jul 08 19:07:46.693721 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:46.693701 2560 generic.go:356] "Generic (PLEG): container finished" podID="afc71143-44f8-4192-b1e8-b46f172f070f" containerID="fdd573ad3ccf12de136e9efbb5ee61a6b5b8eb9d9318da1bd6bf2b5f34722343" exitCode=0 Jul 08 19:07:46.693801 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:46.693777 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" event={"ID":"afc71143-44f8-4192-b1e8-b46f172f070f","Type":"ContainerDied","Data":"fdd573ad3ccf12de136e9efbb5ee61a6b5b8eb9d9318da1bd6bf2b5f34722343"} Jul 08 19:07:46.695948 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:46.695917 2560 generic.go:356] "Generic (PLEG): container finished" podID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerID="ac13a916acfb3b047f7b1d8700d5c1354d9fcd728c9d8ec9989feb4dc9d72e14" exitCode=0 Jul 08 19:07:46.696168 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:46.695951 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" event={"ID":"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d","Type":"ContainerDied","Data":"ac13a916acfb3b047f7b1d8700d5c1354d9fcd728c9d8ec9989feb4dc9d72e14"} Jul 08 19:07:46.698000 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:46.697978 2560 generic.go:356] "Generic (PLEG): container finished" podID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerID="718fd78f92dfef0308b1bef5d85d68b6d752198ee2d2a6a6cd0b2d85e292f882" exitCode=0 Jul 08 19:07:46.698093 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:46.698025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" event={"ID":"367f68f0-bb95-4ba6-8548-2087c768ca21","Type":"ContainerDied","Data":"718fd78f92dfef0308b1bef5d85d68b6d752198ee2d2a6a6cd0b2d85e292f882"} Jul 08 19:07:47.705686 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.705649 2560 generic.go:356] "Generic (PLEG): container finished" podID="afc71143-44f8-4192-b1e8-b46f172f070f" containerID="47fb1aa646a80acc1e7ff73c3d6e3a09f7ca91ac17b56fc59d46000ab04e2608" exitCode=0 Jul 08 19:07:47.706164 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.705739 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" event={"ID":"afc71143-44f8-4192-b1e8-b46f172f070f","Type":"ContainerDied","Data":"47fb1aa646a80acc1e7ff73c3d6e3a09f7ca91ac17b56fc59d46000ab04e2608"} Jul 08 19:07:47.707748 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.707723 2560 generic.go:356] "Generic (PLEG): container finished" podID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerID="223b8d6e7f400c6df1ad5874fce8dc9346e15b0fb46d05e929decbffafeb8c08" exitCode=0 Jul 08 19:07:47.707869 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.707807 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" event={"ID":"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d","Type":"ContainerDied","Data":"223b8d6e7f400c6df1ad5874fce8dc9346e15b0fb46d05e929decbffafeb8c08"} Jul 08 19:07:47.709985 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.709964 2560 generic.go:356] "Generic (PLEG): container finished" podID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerID="0dafd0c41a1ae48c5cbd490a319995f7a09d04b62c00f94ccb5656b2b9c3eb3a" exitCode=0 Jul 08 19:07:47.710081 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.710054 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" event={"ID":"367f68f0-bb95-4ba6-8548-2087c768ca21","Type":"ContainerDied","Data":"0dafd0c41a1ae48c5cbd490a319995f7a09d04b62c00f94ccb5656b2b9c3eb3a"} Jul 08 19:07:47.843010 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.842980 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:47.939548 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.939514 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfcqk\" (UniqueName: \"kubernetes.io/projected/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-kube-api-access-wfcqk\") pod \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " Jul 08 19:07:47.939760 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.939561 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-bundle\") pod \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " Jul 08 19:07:47.939760 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.939610 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-util\") pod \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\" (UID: \"eeb90f18-54e2-44ae-b754-ad1f817f3c6a\") " Jul 08 19:07:47.940294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.940266 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-bundle" (OuterVolumeSpecName: "bundle") pod "eeb90f18-54e2-44ae-b754-ad1f817f3c6a" (UID: "eeb90f18-54e2-44ae-b754-ad1f817f3c6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:47.941980 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.941956 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-kube-api-access-wfcqk" (OuterVolumeSpecName: "kube-api-access-wfcqk") pod "eeb90f18-54e2-44ae-b754-ad1f817f3c6a" (UID: "eeb90f18-54e2-44ae-b754-ad1f817f3c6a"). InnerVolumeSpecName "kube-api-access-wfcqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:07:47.945527 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:47.945497 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-util" (OuterVolumeSpecName: "util") pod "eeb90f18-54e2-44ae-b754-ad1f817f3c6a" (UID: "eeb90f18-54e2-44ae-b754-ad1f817f3c6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:48.040458 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.040414 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:48.040458 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.040447 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-util\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:48.040458 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.040456 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfcqk\" (UniqueName: \"kubernetes.io/projected/eeb90f18-54e2-44ae-b754-ad1f817f3c6a-kube-api-access-wfcqk\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:48.717787 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.717755 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" Jul 08 19:07:48.718185 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.717799 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk" event={"ID":"eeb90f18-54e2-44ae-b754-ad1f817f3c6a","Type":"ContainerDied","Data":"a33660dbb8a1517336df15dd69890dd36120849fb0f3df539cf0057d9a791063"} Jul 08 19:07:48.718185 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.717842 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a33660dbb8a1517336df15dd69890dd36120849fb0f3df539cf0057d9a791063" Jul 08 19:07:48.863117 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.863082 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:48.899137 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.899104 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:48.902584 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.902556 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:48.946758 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946728 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-bundle\") pod \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " Jul 08 19:07:48.946758 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946759 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-util\") pod \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " Jul 08 19:07:48.947010 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946813 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-util\") pod \"afc71143-44f8-4192-b1e8-b46f172f070f\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " Jul 08 19:07:48.947010 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946836 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-util\") pod \"367f68f0-bb95-4ba6-8548-2087c768ca21\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " Jul 08 19:07:48.947010 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946864 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf678\" (UniqueName: \"kubernetes.io/projected/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-kube-api-access-pf678\") pod \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\" (UID: \"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d\") " Jul 08 19:07:48.947010 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946889 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-bundle\") pod \"367f68f0-bb95-4ba6-8548-2087c768ca21\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " Jul 08 19:07:48.947010 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946938 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvs6q\" (UniqueName: \"kubernetes.io/projected/367f68f0-bb95-4ba6-8548-2087c768ca21-kube-api-access-qvs6q\") pod \"367f68f0-bb95-4ba6-8548-2087c768ca21\" (UID: \"367f68f0-bb95-4ba6-8548-2087c768ca21\") " Jul 08 19:07:48.947010 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946963 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-bundle\") pod \"afc71143-44f8-4192-b1e8-b46f172f070f\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " Jul 08 19:07:48.947010 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.946986 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5b62\" (UniqueName: \"kubernetes.io/projected/afc71143-44f8-4192-b1e8-b46f172f070f-kube-api-access-h5b62\") pod \"afc71143-44f8-4192-b1e8-b46f172f070f\" (UID: \"afc71143-44f8-4192-b1e8-b46f172f070f\") " Jul 08 19:07:48.948234 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.947578 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-bundle" (OuterVolumeSpecName: "bundle") pod "367f68f0-bb95-4ba6-8548-2087c768ca21" (UID: "367f68f0-bb95-4ba6-8548-2087c768ca21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:48.948234 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.948046 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-bundle" (OuterVolumeSpecName: "bundle") pod "e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" (UID: "e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:48.948234 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.948184 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-bundle" (OuterVolumeSpecName: "bundle") pod "afc71143-44f8-4192-b1e8-b46f172f070f" (UID: "afc71143-44f8-4192-b1e8-b46f172f070f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:48.950032 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.950004 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc71143-44f8-4192-b1e8-b46f172f070f-kube-api-access-h5b62" (OuterVolumeSpecName: "kube-api-access-h5b62") pod "afc71143-44f8-4192-b1e8-b46f172f070f" (UID: "afc71143-44f8-4192-b1e8-b46f172f070f"). InnerVolumeSpecName "kube-api-access-h5b62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:07:48.950127 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.950055 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-kube-api-access-pf678" (OuterVolumeSpecName: "kube-api-access-pf678") pod "e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" (UID: "e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d"). InnerVolumeSpecName "kube-api-access-pf678". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:07:48.950364 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.950339 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/367f68f0-bb95-4ba6-8548-2087c768ca21-kube-api-access-qvs6q" (OuterVolumeSpecName: "kube-api-access-qvs6q") pod "367f68f0-bb95-4ba6-8548-2087c768ca21" (UID: "367f68f0-bb95-4ba6-8548-2087c768ca21"). InnerVolumeSpecName "kube-api-access-qvs6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:07:48.954034 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.954008 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-util" (OuterVolumeSpecName: "util") pod "afc71143-44f8-4192-b1e8-b46f172f070f" (UID: "afc71143-44f8-4192-b1e8-b46f172f070f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:48.954539 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.954511 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-util" (OuterVolumeSpecName: "util") pod "367f68f0-bb95-4ba6-8548-2087c768ca21" (UID: "367f68f0-bb95-4ba6-8548-2087c768ca21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:48.955572 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:48.955549 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-util" (OuterVolumeSpecName: "util") pod "e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" (UID: "e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047824 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047860 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-util\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047873 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-util\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047881 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-util\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047889 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf678\" (UniqueName: \"kubernetes.io/projected/e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d-kube-api-access-pf678\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047899 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/367f68f0-bb95-4ba6-8548-2087c768ca21-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047908 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvs6q\" (UniqueName: \"kubernetes.io/projected/367f68f0-bb95-4ba6-8548-2087c768ca21-kube-api-access-qvs6q\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047915 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/afc71143-44f8-4192-b1e8-b46f172f070f-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.047917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.047923 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5b62\" (UniqueName: \"kubernetes.io/projected/afc71143-44f8-4192-b1e8-b46f172f070f-kube-api-access-h5b62\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:07:49.725674 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.725640 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" Jul 08 19:07:49.726114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.725648 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92" event={"ID":"afc71143-44f8-4192-b1e8-b46f172f070f","Type":"ContainerDied","Data":"4f5652b0684b5df50dcdd97731ed5a60fd64e59f99c78f418384f39384207f86"} Jul 08 19:07:49.726114 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.725788 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f5652b0684b5df50dcdd97731ed5a60fd64e59f99c78f418384f39384207f86" Jul 08 19:07:49.727625 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.727586 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" event={"ID":"e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d","Type":"ContainerDied","Data":"89ea808375950ef0793969950bbeb07d1b07560ad34b0f2660da2759727c0543"} Jul 08 19:07:49.727758 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.727633 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89ea808375950ef0793969950bbeb07d1b07560ad34b0f2660da2759727c0543" Jul 08 19:07:49.727758 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.727595 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r" Jul 08 19:07:49.737671 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.737599 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" event={"ID":"367f68f0-bb95-4ba6-8548-2087c768ca21","Type":"ContainerDied","Data":"19aec42137dd3f17391cb27528f0af7ccc961c3322d5f806f04b2c3884aedf6e"} Jul 08 19:07:49.737671 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.737660 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl" Jul 08 19:07:49.737816 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:07:49.737702 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19aec42137dd3f17391cb27528f0af7ccc961c3322d5f806f04b2c3884aedf6e" Jul 08 19:08:01.092836 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.092800 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86c495ccdd-wgdf8"] Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093176 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerName="util" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093188 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerName="util" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093198 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerName="util" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093203 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerName="util" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093211 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerName="pull" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093220 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerName="pull" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093230 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerName="extract" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093235 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerName="extract" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093242 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc71143-44f8-4192-b1e8-b46f172f070f" containerName="pull" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093247 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc71143-44f8-4192-b1e8-b46f172f070f" containerName="pull" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093255 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerName="pull" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093260 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerName="pull" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093265 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc71143-44f8-4192-b1e8-b46f172f070f" containerName="extract" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093270 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc71143-44f8-4192-b1e8-b46f172f070f" containerName="extract" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093276 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afc71143-44f8-4192-b1e8-b46f172f070f" containerName="util" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093280 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="afc71143-44f8-4192-b1e8-b46f172f070f" containerName="util" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093285 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerName="extract" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093289 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerName="extract" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093299 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerName="util" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093308 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerName="util" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093315 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerName="extract" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093320 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerName="extract" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093328 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerName="pull" Jul 08 19:08:01.093339 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093332 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerName="pull" Jul 08 19:08:01.094124 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093409 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="367f68f0-bb95-4ba6-8548-2087c768ca21" containerName="extract" Jul 08 19:08:01.094124 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093422 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="afc71143-44f8-4192-b1e8-b46f172f070f" containerName="extract" Jul 08 19:08:01.094124 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093429 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d" containerName="extract" Jul 08 19:08:01.094124 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.093435 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb90f18-54e2-44ae-b754-ad1f817f3c6a" containerName="extract" Jul 08 19:08:01.097741 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.097722 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.117449 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.117421 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86c495ccdd-wgdf8"] Jul 08 19:08:01.157985 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.157946 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpdkt\" (UniqueName: \"kubernetes.io/projected/b69a621c-e367-42b9-aef9-244e3e528b18-kube-api-access-vpdkt\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.158193 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.157990 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-service-ca\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.158193 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.158112 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-console-config\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.158193 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.158152 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-trusted-ca-bundle\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.158362 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.158255 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69a621c-e367-42b9-aef9-244e3e528b18-console-serving-cert\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.158362 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.158321 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-oauth-serving-cert\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.158362 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.158348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69a621c-e367-42b9-aef9-244e3e528b18-console-oauth-config\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.259328 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.259282 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-console-config\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.259328 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.259332 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-trusted-ca-bundle\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.259659 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.259427 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69a621c-e367-42b9-aef9-244e3e528b18-console-serving-cert\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.259659 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.259472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-oauth-serving-cert\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.259659 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.259508 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69a621c-e367-42b9-aef9-244e3e528b18-console-oauth-config\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.259659 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.259546 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpdkt\" (UniqueName: \"kubernetes.io/projected/b69a621c-e367-42b9-aef9-244e3e528b18-kube-api-access-vpdkt\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.259877 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.259730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-service-ca\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.260144 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.260116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-console-config\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.260243 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.260212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-oauth-serving-cert\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.260353 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.260331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-trusted-ca-bundle\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.260468 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.260449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b69a621c-e367-42b9-aef9-244e3e528b18-service-ca\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.262145 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.262126 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b69a621c-e367-42b9-aef9-244e3e528b18-console-serving-cert\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.262243 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.262223 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b69a621c-e367-42b9-aef9-244e3e528b18-console-oauth-config\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.279126 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.279097 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpdkt\" (UniqueName: \"kubernetes.io/projected/b69a621c-e367-42b9-aef9-244e3e528b18-kube-api-access-vpdkt\") pod \"console-86c495ccdd-wgdf8\" (UID: \"b69a621c-e367-42b9-aef9-244e3e528b18\") " pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.407972 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.407878 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:01.556206 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.556134 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86c495ccdd-wgdf8"] Jul 08 19:08:01.560271 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:08:01.560244 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb69a621c_e367_42b9_aef9_244e3e528b18.slice/crio-61d52a91ee839475ca57d18a97ff4c6d113799d985ba12859b2476d8b9583ca5 WatchSource:0}: Error finding container 61d52a91ee839475ca57d18a97ff4c6d113799d985ba12859b2476d8b9583ca5: Status 404 returned error can't find the container with id 61d52a91ee839475ca57d18a97ff4c6d113799d985ba12859b2476d8b9583ca5 Jul 08 19:08:01.799248 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.799213 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c495ccdd-wgdf8" event={"ID":"b69a621c-e367-42b9-aef9-244e3e528b18","Type":"ContainerStarted","Data":"b60f151474471246f5e444cc53228251af34bd9098d85f9a7e19c5528882b7f6"} Jul 08 19:08:01.799459 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.799264 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86c495ccdd-wgdf8" event={"ID":"b69a621c-e367-42b9-aef9-244e3e528b18","Type":"ContainerStarted","Data":"61d52a91ee839475ca57d18a97ff4c6d113799d985ba12859b2476d8b9583ca5"} Jul 08 19:08:01.825099 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:01.825031 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86c495ccdd-wgdf8" podStartSLOduration=0.825008697 podStartE2EDuration="825.008697ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:01.824182582 +0000 UTC m=+380.515174105" watchObservedRunningTime="2026-07-08 19:08:01.825008697 +0000 UTC m=+380.516000219" Jul 08 19:08:11.408233 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.408191 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:11.408733 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.408271 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:11.412991 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.412966 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:11.624435 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.624340 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb"] Jul 08 19:08:11.628268 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.628239 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" Jul 08 19:08:11.631598 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.631568 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 19:08:11.632660 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.632644 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-swxm4\"" Jul 08 19:08:11.632922 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.632908 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 19:08:11.640128 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.640099 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb"] Jul 08 19:08:11.641702 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.641680 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 19:08:11.760822 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.760784 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twkxj\" (UniqueName: \"kubernetes.io/projected/d4001106-9ad2-4a62-a3e0-fc2e1f52ad58-kube-api-access-twkxj\") pod \"dns-operator-controller-manager-864dd78c4c-nbhwb\" (UID: \"d4001106-9ad2-4a62-a3e0-fc2e1f52ad58\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" Jul 08 19:08:11.861634 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.861599 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twkxj\" (UniqueName: \"kubernetes.io/projected/d4001106-9ad2-4a62-a3e0-fc2e1f52ad58-kube-api-access-twkxj\") pod \"dns-operator-controller-manager-864dd78c4c-nbhwb\" (UID: \"d4001106-9ad2-4a62-a3e0-fc2e1f52ad58\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" Jul 08 19:08:11.862237 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.862218 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86c495ccdd-wgdf8" Jul 08 19:08:11.880245 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.880220 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twkxj\" (UniqueName: \"kubernetes.io/projected/d4001106-9ad2-4a62-a3e0-fc2e1f52ad58-kube-api-access-twkxj\") pod \"dns-operator-controller-manager-864dd78c4c-nbhwb\" (UID: \"d4001106-9ad2-4a62-a3e0-fc2e1f52ad58\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" Jul 08 19:08:11.940517 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.940469 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" Jul 08 19:08:11.951636 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:11.951597 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55d5fbcc97-7zrfn"] Jul 08 19:08:12.097958 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:12.097930 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb"] Jul 08 19:08:12.100802 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:08:12.100776 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4001106_9ad2_4a62_a3e0_fc2e1f52ad58.slice/crio-3d238070c6574ddc294b8ad54ae4e384c6c602634222e51c1e40d6c0a0614af0 WatchSource:0}: Error finding container 3d238070c6574ddc294b8ad54ae4e384c6c602634222e51c1e40d6c0a0614af0: Status 404 returned error can't find the container with id 3d238070c6574ddc294b8ad54ae4e384c6c602634222e51c1e40d6c0a0614af0 Jul 08 19:08:12.865829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:12.865781 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" event={"ID":"d4001106-9ad2-4a62-a3e0-fc2e1f52ad58","Type":"ContainerStarted","Data":"3d238070c6574ddc294b8ad54ae4e384c6c602634222e51c1e40d6c0a0614af0"} Jul 08 19:08:14.880178 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:14.880141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" event={"ID":"d4001106-9ad2-4a62-a3e0-fc2e1f52ad58","Type":"ContainerStarted","Data":"4266e8db375d6ab2024bdc41feb49dc9febb3172b1dd499f223fe144e78c564e"} Jul 08 19:08:14.880619 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:14.880263 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" Jul 08 19:08:14.916125 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:14.916067 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" podStartSLOduration=1.250858986 podStartE2EDuration="3.916047878s" totalImagesPullingTime="2.665188892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:14.91422738 +0000 UTC m=+393.605218904" watchObservedRunningTime="2026-07-08 19:08:14.916047878 +0000 UTC m=+393.607039400" Jul 08 19:08:25.886972 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:25.886935 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nbhwb" Jul 08 19:08:30.738830 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.738792 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2"] Jul 08 19:08:30.744540 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.744504 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:30.746571 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.746538 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-chtd7\"" Jul 08 19:08:30.760448 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.760418 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2"] Jul 08 19:08:30.839101 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.839065 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w4nb2\" (UID: \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:30.839307 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.839103 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn46z\" (UniqueName: \"kubernetes.io/projected/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-kube-api-access-fn46z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w4nb2\" (UID: \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:30.940033 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.939995 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w4nb2\" (UID: \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:30.940033 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.940032 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn46z\" (UniqueName: \"kubernetes.io/projected/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-kube-api-access-fn46z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w4nb2\" (UID: \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:30.940429 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.940373 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w4nb2\" (UID: \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:30.951737 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:30.951703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn46z\" (UniqueName: \"kubernetes.io/projected/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-kube-api-access-fn46z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w4nb2\" (UID: \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:31.061450 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:31.061312 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:31.207698 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:31.207664 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2"] Jul 08 19:08:31.210442 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:08:31.210410 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef414a9_cc4f_422a_87f1_b1de31cbda1a.slice/crio-1de2af390fafb6c2b18ab846729a1817c14b3b647ebaeed651c85e52e1baefd0 WatchSource:0}: Error finding container 1de2af390fafb6c2b18ab846729a1817c14b3b647ebaeed651c85e52e1baefd0: Status 404 returned error can't find the container with id 1de2af390fafb6c2b18ab846729a1817c14b3b647ebaeed651c85e52e1baefd0 Jul 08 19:08:31.975614 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:31.975574 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" event={"ID":"9ef414a9-cc4f-422a-87f1-b1de31cbda1a","Type":"ContainerStarted","Data":"1de2af390fafb6c2b18ab846729a1817c14b3b647ebaeed651c85e52e1baefd0"} Jul 08 19:08:36.976662 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:36.976591 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55d5fbcc97-7zrfn" podUID="61134e51-b573-40a9-9ae0-3831d70600a4" containerName="console" containerID="cri-o://2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3" gracePeriod=15 Jul 08 19:08:37.693576 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.693549 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:08:37.800872 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.800775 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-service-ca\") pod \"61134e51-b573-40a9-9ae0-3831d70600a4\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " Jul 08 19:08:37.800872 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.800822 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-serving-cert\") pod \"61134e51-b573-40a9-9ae0-3831d70600a4\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " Jul 08 19:08:37.800872 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.800852 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-trusted-ca-bundle\") pod \"61134e51-b573-40a9-9ae0-3831d70600a4\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " Jul 08 19:08:37.801111 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.800898 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-oauth-config\") pod \"61134e51-b573-40a9-9ae0-3831d70600a4\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " Jul 08 19:08:37.801111 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.800924 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfvzf\" (UniqueName: \"kubernetes.io/projected/61134e51-b573-40a9-9ae0-3831d70600a4-kube-api-access-gfvzf\") pod \"61134e51-b573-40a9-9ae0-3831d70600a4\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " Jul 08 19:08:37.801111 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.800970 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-oauth-serving-cert\") pod \"61134e51-b573-40a9-9ae0-3831d70600a4\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " Jul 08 19:08:37.801111 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.801031 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-console-config\") pod \"61134e51-b573-40a9-9ae0-3831d70600a4\" (UID: \"61134e51-b573-40a9-9ae0-3831d70600a4\") " Jul 08 19:08:37.801311 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.801233 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "61134e51-b573-40a9-9ae0-3831d70600a4" (UID: "61134e51-b573-40a9-9ae0-3831d70600a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:08:37.801491 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.801455 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "61134e51-b573-40a9-9ae0-3831d70600a4" (UID: "61134e51-b573-40a9-9ae0-3831d70600a4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:08:37.801580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.801480 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-console-config" (OuterVolumeSpecName: "console-config") pod "61134e51-b573-40a9-9ae0-3831d70600a4" (UID: "61134e51-b573-40a9-9ae0-3831d70600a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:08:37.801649 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.801623 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "61134e51-b573-40a9-9ae0-3831d70600a4" (UID: "61134e51-b573-40a9-9ae0-3831d70600a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:08:37.803346 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.803324 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "61134e51-b573-40a9-9ae0-3831d70600a4" (UID: "61134e51-b573-40a9-9ae0-3831d70600a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:08:37.803882 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.803853 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "61134e51-b573-40a9-9ae0-3831d70600a4" (UID: "61134e51-b573-40a9-9ae0-3831d70600a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:08:37.803882 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.803862 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61134e51-b573-40a9-9ae0-3831d70600a4-kube-api-access-gfvzf" (OuterVolumeSpecName: "kube-api-access-gfvzf") pod "61134e51-b573-40a9-9ae0-3831d70600a4" (UID: "61134e51-b573-40a9-9ae0-3831d70600a4"). InnerVolumeSpecName "kube-api-access-gfvzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:08:37.901709 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.901664 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-oauth-config\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:37.901709 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.901700 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfvzf\" (UniqueName: \"kubernetes.io/projected/61134e51-b573-40a9-9ae0-3831d70600a4-kube-api-access-gfvzf\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:37.901709 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.901713 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-oauth-serving-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:37.901965 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.901724 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-console-config\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:37.901965 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.901736 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-service-ca\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:37.901965 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.901747 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61134e51-b573-40a9-9ae0-3831d70600a4-console-serving-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:37.901965 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:37.901759 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61134e51-b573-40a9-9ae0-3831d70600a4-trusted-ca-bundle\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:38.012622 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.012588 2560 generic.go:356] "Generic (PLEG): container finished" podID="61134e51-b573-40a9-9ae0-3831d70600a4" containerID="2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3" exitCode=0 Jul 08 19:08:38.013064 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.012642 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55d5fbcc97-7zrfn" Jul 08 19:08:38.013064 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.012673 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5fbcc97-7zrfn" event={"ID":"61134e51-b573-40a9-9ae0-3831d70600a4","Type":"ContainerDied","Data":"2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3"} Jul 08 19:08:38.013064 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.012732 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55d5fbcc97-7zrfn" event={"ID":"61134e51-b573-40a9-9ae0-3831d70600a4","Type":"ContainerDied","Data":"82dbaec80a953cec48a907c2329f02b2f7136d312f3d48da7581d5b72f6af059"} Jul 08 19:08:38.013064 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.012757 2560 scope.go:117] "RemoveContainer" containerID="2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3" Jul 08 19:08:38.015148 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.015114 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" event={"ID":"9ef414a9-cc4f-422a-87f1-b1de31cbda1a","Type":"ContainerStarted","Data":"bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367"} Jul 08 19:08:38.015317 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.015281 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:38.023197 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.023177 2560 scope.go:117] "RemoveContainer" containerID="2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3" Jul 08 19:08:38.023570 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:08:38.023539 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3\": container with ID starting with 2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3 not found: ID does not exist" containerID="2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3" Jul 08 19:08:38.023636 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.023582 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3"} err="failed to get container status \"2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3\": rpc error: code = NotFound desc = could not find container \"2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3\": container with ID starting with 2ee75d0db36a616ce111477906fe9b843d0f04768c91ba056a6477ff2fdceac3 not found: ID does not exist" Jul 08 19:08:38.035311 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.035282 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55d5fbcc97-7zrfn"] Jul 08 19:08:38.043507 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.043482 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55d5fbcc97-7zrfn"] Jul 08 19:08:38.063089 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:38.062986 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" podStartSLOduration=1.675186698 podStartE2EDuration="8.062969345s" totalImagesPullingTime="6.387782647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:08:38.062502768 +0000 UTC m=+416.753494292" watchObservedRunningTime="2026-07-08 19:08:38.062969345 +0000 UTC m=+416.753960868" Jul 08 19:08:39.959328 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:39.959281 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61134e51-b573-40a9-9ae0-3831d70600a4" path="/var/lib/kubelet/pods/61134e51-b573-40a9-9ae0-3831d70600a4/volumes" Jul 08 19:08:42.939450 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:42.939409 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2"] Jul 08 19:08:42.939960 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:42.939775 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" podUID="9ef414a9-cc4f-422a-87f1-b1de31cbda1a" containerName="manager" containerID="cri-o://bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367" gracePeriod=10 Jul 08 19:08:42.941517 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:42.941493 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:43.198246 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:43.198184 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:43.246874 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:43.246844 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn46z\" (UniqueName: \"kubernetes.io/projected/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-kube-api-access-fn46z\") pod \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\" (UID: \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\") " Jul 08 19:08:43.247057 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:43.246944 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-extensions-socket-volume\") pod \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\" (UID: \"9ef414a9-cc4f-422a-87f1-b1de31cbda1a\") " Jul 08 19:08:43.247411 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:43.247364 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9ef414a9-cc4f-422a-87f1-b1de31cbda1a" (UID: "9ef414a9-cc4f-422a-87f1-b1de31cbda1a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:08:43.249486 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:43.249452 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-kube-api-access-fn46z" (OuterVolumeSpecName: "kube-api-access-fn46z") pod "9ef414a9-cc4f-422a-87f1-b1de31cbda1a" (UID: "9ef414a9-cc4f-422a-87f1-b1de31cbda1a"). InnerVolumeSpecName "kube-api-access-fn46z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:08:43.347727 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:43.347687 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-extensions-socket-volume\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:43.347727 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:43.347719 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn46z\" (UniqueName: \"kubernetes.io/projected/9ef414a9-cc4f-422a-87f1-b1de31cbda1a-kube-api-access-fn46z\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:08:44.055864 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.055817 2560 generic.go:356] "Generic (PLEG): container finished" podID="9ef414a9-cc4f-422a-87f1-b1de31cbda1a" containerID="bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367" exitCode=0 Jul 08 19:08:44.056290 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.055885 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" Jul 08 19:08:44.056290 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.055907 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" event={"ID":"9ef414a9-cc4f-422a-87f1-b1de31cbda1a","Type":"ContainerDied","Data":"bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367"} Jul 08 19:08:44.056290 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.055985 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2" event={"ID":"9ef414a9-cc4f-422a-87f1-b1de31cbda1a","Type":"ContainerDied","Data":"1de2af390fafb6c2b18ab846729a1817c14b3b647ebaeed651c85e52e1baefd0"} Jul 08 19:08:44.056290 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.056012 2560 scope.go:117] "RemoveContainer" containerID="bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367" Jul 08 19:08:44.065718 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.065691 2560 scope.go:117] "RemoveContainer" containerID="bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367" Jul 08 19:08:44.066071 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:08:44.066036 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367\": container with ID starting with bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367 not found: ID does not exist" containerID="bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367" Jul 08 19:08:44.066154 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.066081 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367"} err="failed to get container status \"bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367\": rpc error: code = NotFound desc = could not find container \"bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367\": container with ID starting with bc822607798fe89f1d9b3f7ae509bca08381e2d60e5e731bc5412935c39a0367 not found: ID does not exist" Jul 08 19:08:44.073877 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.073843 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2"] Jul 08 19:08:44.081757 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:44.081728 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w4nb2"] Jul 08 19:08:45.958107 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:08:45.958065 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ef414a9-cc4f-422a-87f1-b1de31cbda1a" path="/var/lib/kubelet/pods/9ef414a9-cc4f-422a-87f1-b1de31cbda1a/volumes" Jul 08 19:09:12.904843 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.904758 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bjw8"] Jul 08 19:09:12.905401 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.905120 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61134e51-b573-40a9-9ae0-3831d70600a4" containerName="console" Jul 08 19:09:12.905401 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.905133 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="61134e51-b573-40a9-9ae0-3831d70600a4" containerName="console" Jul 08 19:09:12.905401 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.905160 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ef414a9-cc4f-422a-87f1-b1de31cbda1a" containerName="manager" Jul 08 19:09:12.905401 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.905169 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ef414a9-cc4f-422a-87f1-b1de31cbda1a" containerName="manager" Jul 08 19:09:12.905401 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.905236 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="61134e51-b573-40a9-9ae0-3831d70600a4" containerName="console" Jul 08 19:09:12.905401 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.905246 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ef414a9-cc4f-422a-87f1-b1de31cbda1a" containerName="manager" Jul 08 19:09:12.908895 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.908878 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:12.911358 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.911332 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c8qc2\"" Jul 08 19:09:12.911358 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.911333 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 19:09:12.918418 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:12.918375 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bjw8"] Jul 08 19:09:13.003450 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.003419 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bjw8"] Jul 08 19:09:13.023137 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.023107 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd24e385-2daf-4dd6-a933-461be1cf4c83-config-file\") pod \"limitador-limitador-64c94fd64f-5bjw8\" (UID: \"dd24e385-2daf-4dd6-a933-461be1cf4c83\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:13.023299 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.023188 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd2xj\" (UniqueName: \"kubernetes.io/projected/dd24e385-2daf-4dd6-a933-461be1cf4c83-kube-api-access-sd2xj\") pod \"limitador-limitador-64c94fd64f-5bjw8\" (UID: \"dd24e385-2daf-4dd6-a933-461be1cf4c83\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:13.124695 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.124653 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd24e385-2daf-4dd6-a933-461be1cf4c83-config-file\") pod \"limitador-limitador-64c94fd64f-5bjw8\" (UID: \"dd24e385-2daf-4dd6-a933-461be1cf4c83\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:13.124917 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.124748 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd2xj\" (UniqueName: \"kubernetes.io/projected/dd24e385-2daf-4dd6-a933-461be1cf4c83-kube-api-access-sd2xj\") pod \"limitador-limitador-64c94fd64f-5bjw8\" (UID: \"dd24e385-2daf-4dd6-a933-461be1cf4c83\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:13.125360 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.125340 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd24e385-2daf-4dd6-a933-461be1cf4c83-config-file\") pod \"limitador-limitador-64c94fd64f-5bjw8\" (UID: \"dd24e385-2daf-4dd6-a933-461be1cf4c83\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:13.134829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.134797 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd2xj\" (UniqueName: \"kubernetes.io/projected/dd24e385-2daf-4dd6-a933-461be1cf4c83-kube-api-access-sd2xj\") pod \"limitador-limitador-64c94fd64f-5bjw8\" (UID: \"dd24e385-2daf-4dd6-a933-461be1cf4c83\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:13.220551 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.220516 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:13.363238 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:13.363204 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bjw8"] Jul 08 19:09:13.366290 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:09:13.366263 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd24e385_2daf_4dd6_a933_461be1cf4c83.slice/crio-6946c5cfb0daa7668ecff4446a251c2bf5e9d4105afb41de260caf13cd5ba7c2 WatchSource:0}: Error finding container 6946c5cfb0daa7668ecff4446a251c2bf5e9d4105afb41de260caf13cd5ba7c2: Status 404 returned error can't find the container with id 6946c5cfb0daa7668ecff4446a251c2bf5e9d4105afb41de260caf13cd5ba7c2 Jul 08 19:09:14.214828 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:14.214787 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" event={"ID":"dd24e385-2daf-4dd6-a933-461be1cf4c83","Type":"ContainerStarted","Data":"6946c5cfb0daa7668ecff4446a251c2bf5e9d4105afb41de260caf13cd5ba7c2"} Jul 08 19:09:16.228584 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:16.228551 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" event={"ID":"dd24e385-2daf-4dd6-a933-461be1cf4c83","Type":"ContainerStarted","Data":"72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5"} Jul 08 19:09:16.229005 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:16.228650 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:16.247376 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:16.247322 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" podStartSLOduration=1.560093108 podStartE2EDuration="4.247302662s" totalImagesPullingTime="2.687209554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:16.246297597 +0000 UTC m=+454.937289119" watchObservedRunningTime="2026-07-08 19:09:16.247302662 +0000 UTC m=+454.938294183" Jul 08 19:09:27.235834 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:27.235804 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:28.163688 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.163647 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bjw8"] Jul 08 19:09:28.163883 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.163846 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" podUID="dd24e385-2daf-4dd6-a933-461be1cf4c83" containerName="limitador" containerID="cri-o://72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5" gracePeriod=30 Jul 08 19:09:28.716628 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.716598 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:28.767454 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.767327 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd24e385-2daf-4dd6-a933-461be1cf4c83-config-file\") pod \"dd24e385-2daf-4dd6-a933-461be1cf4c83\" (UID: \"dd24e385-2daf-4dd6-a933-461be1cf4c83\") " Jul 08 19:09:28.767454 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.767443 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd2xj\" (UniqueName: \"kubernetes.io/projected/dd24e385-2daf-4dd6-a933-461be1cf4c83-kube-api-access-sd2xj\") pod \"dd24e385-2daf-4dd6-a933-461be1cf4c83\" (UID: \"dd24e385-2daf-4dd6-a933-461be1cf4c83\") " Jul 08 19:09:28.767725 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.767700 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd24e385-2daf-4dd6-a933-461be1cf4c83-config-file" (OuterVolumeSpecName: "config-file") pod "dd24e385-2daf-4dd6-a933-461be1cf4c83" (UID: "dd24e385-2daf-4dd6-a933-461be1cf4c83"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:09:28.769673 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.769635 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd24e385-2daf-4dd6-a933-461be1cf4c83-kube-api-access-sd2xj" (OuterVolumeSpecName: "kube-api-access-sd2xj") pod "dd24e385-2daf-4dd6-a933-461be1cf4c83" (UID: "dd24e385-2daf-4dd6-a933-461be1cf4c83"). InnerVolumeSpecName "kube-api-access-sd2xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:09:28.868462 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.868421 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd2xj\" (UniqueName: \"kubernetes.io/projected/dd24e385-2daf-4dd6-a933-461be1cf4c83-kube-api-access-sd2xj\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:09:28.868462 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:28.868458 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dd24e385-2daf-4dd6-a933-461be1cf4c83-config-file\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:09:29.299477 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.299442 2560 generic.go:356] "Generic (PLEG): container finished" podID="dd24e385-2daf-4dd6-a933-461be1cf4c83" containerID="72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5" exitCode=0 Jul 08 19:09:29.299658 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.299496 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" Jul 08 19:09:29.299658 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.299528 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" event={"ID":"dd24e385-2daf-4dd6-a933-461be1cf4c83","Type":"ContainerDied","Data":"72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5"} Jul 08 19:09:29.299658 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.299581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5bjw8" event={"ID":"dd24e385-2daf-4dd6-a933-461be1cf4c83","Type":"ContainerDied","Data":"6946c5cfb0daa7668ecff4446a251c2bf5e9d4105afb41de260caf13cd5ba7c2"} Jul 08 19:09:29.299658 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.299603 2560 scope.go:117] "RemoveContainer" containerID="72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5" Jul 08 19:09:29.308755 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.308733 2560 scope.go:117] "RemoveContainer" containerID="72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5" Jul 08 19:09:29.309033 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:09:29.309013 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5\": container with ID starting with 72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5 not found: ID does not exist" containerID="72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5" Jul 08 19:09:29.309101 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.309039 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5"} err="failed to get container status \"72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5\": rpc error: code = NotFound desc = could not find container \"72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5\": container with ID starting with 72ffdedd3227d3359e7009e635d794b87c794f5a073c17e0bd98a158586070e5 not found: ID does not exist" Jul 08 19:09:29.321464 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.321437 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bjw8"] Jul 08 19:09:29.324735 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.324708 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5bjw8"] Jul 08 19:09:29.958289 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:29.958255 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd24e385-2daf-4dd6-a933-461be1cf4c83" path="/var/lib/kubelet/pods/dd24e385-2daf-4dd6-a933-461be1cf4c83/volumes" Jul 08 19:09:33.677375 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.677342 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bjt49"] Jul 08 19:09:33.677891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.677771 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd24e385-2daf-4dd6-a933-461be1cf4c83" containerName="limitador" Jul 08 19:09:33.677891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.677785 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd24e385-2daf-4dd6-a933-461be1cf4c83" containerName="limitador" Jul 08 19:09:33.677891 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.677868 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd24e385-2daf-4dd6-a933-461be1cf4c83" containerName="limitador" Jul 08 19:09:33.681123 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.681107 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:33.683406 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.683368 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 19:09:33.683530 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.683443 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 19:09:33.683674 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.683658 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zck59\"" Jul 08 19:09:33.683746 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.683684 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 19:09:33.689885 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.689863 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bjt49"] Jul 08 19:09:33.811018 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.810978 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z77rb\" (UniqueName: \"kubernetes.io/projected/63808c51-c718-4128-832f-36d3e176a0fe-kube-api-access-z77rb\") pod \"postgres-69fb4594cf-bjt49\" (UID: \"63808c51-c718-4128-832f-36d3e176a0fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:33.811201 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.811033 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63808c51-c718-4128-832f-36d3e176a0fe-data\") pod \"postgres-69fb4594cf-bjt49\" (UID: \"63808c51-c718-4128-832f-36d3e176a0fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:33.911611 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.911574 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z77rb\" (UniqueName: \"kubernetes.io/projected/63808c51-c718-4128-832f-36d3e176a0fe-kube-api-access-z77rb\") pod \"postgres-69fb4594cf-bjt49\" (UID: \"63808c51-c718-4128-832f-36d3e176a0fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:33.911781 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.911625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63808c51-c718-4128-832f-36d3e176a0fe-data\") pod \"postgres-69fb4594cf-bjt49\" (UID: \"63808c51-c718-4128-832f-36d3e176a0fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:33.911966 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.911951 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/63808c51-c718-4128-832f-36d3e176a0fe-data\") pod \"postgres-69fb4594cf-bjt49\" (UID: \"63808c51-c718-4128-832f-36d3e176a0fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:33.920374 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.920348 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z77rb\" (UniqueName: \"kubernetes.io/projected/63808c51-c718-4128-832f-36d3e176a0fe-kube-api-access-z77rb\") pod \"postgres-69fb4594cf-bjt49\" (UID: \"63808c51-c718-4128-832f-36d3e176a0fe\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:33.992700 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:33.992664 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:34.132167 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:34.132141 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-bjt49"] Jul 08 19:09:34.134229 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:09:34.134197 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63808c51_c718_4128_832f_36d3e176a0fe.slice/crio-c94068a0385bc7b32892c1df7c0cf5c26c8a58bb5631f78ece32ae0401fbd757 WatchSource:0}: Error finding container c94068a0385bc7b32892c1df7c0cf5c26c8a58bb5631f78ece32ae0401fbd757: Status 404 returned error can't find the container with id c94068a0385bc7b32892c1df7c0cf5c26c8a58bb5631f78ece32ae0401fbd757 Jul 08 19:09:34.328809 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:34.328706 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" event={"ID":"63808c51-c718-4128-832f-36d3e176a0fe","Type":"ContainerStarted","Data":"c94068a0385bc7b32892c1df7c0cf5c26c8a58bb5631f78ece32ae0401fbd757"} Jul 08 19:09:39.360491 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:39.360448 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" event={"ID":"63808c51-c718-4128-832f-36d3e176a0fe","Type":"ContainerStarted","Data":"48e9c2d18f97dba8198082def84ec7fb7ac2e764bea83f615a55c0922470c5a6"} Jul 08 19:09:39.360903 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:39.360523 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:39.377524 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:39.377468 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" podStartSLOduration=1.619744686 podStartE2EDuration="6.377451338s" totalImagesPullingTime="4.757706652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:39.375211295 +0000 UTC m=+478.066202828" watchObservedRunningTime="2026-07-08 19:09:39.377451338 +0000 UTC m=+478.068442859" Jul 08 19:09:45.397265 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:45.397234 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-bjt49" Jul 08 19:09:52.782243 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.782204 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dbc8c7466-qlhg4"] Jul 08 19:09:52.805846 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.805814 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbc8c7466-qlhg4"] Jul 08 19:09:52.806025 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.805922 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:52.807911 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.807887 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 19:09:52.807911 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.807902 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 19:09:52.808089 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.807907 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zdrct\"" Jul 08 19:09:52.880574 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.880533 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert\") pod \"maas-controller-dbc8c7466-qlhg4\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:52.880769 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.880659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hl5v\" (UniqueName: \"kubernetes.io/projected/aa268f72-1dcd-4309-a848-89d7d2eda928-kube-api-access-8hl5v\") pod \"maas-controller-dbc8c7466-qlhg4\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:52.954666 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.954625 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-c8ztc"] Jul 08 19:09:52.964974 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.964939 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:52.968137 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.968113 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-c8ztc"] Jul 08 19:09:52.981525 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.981497 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hl5v\" (UniqueName: \"kubernetes.io/projected/aa268f72-1dcd-4309-a848-89d7d2eda928-kube-api-access-8hl5v\") pod \"maas-controller-dbc8c7466-qlhg4\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:52.981670 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.981547 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert\") pod \"maas-controller-dbc8c7466-qlhg4\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:52.981670 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:09:52.981639 2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 08 19:09:52.981742 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:09:52.981691 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert podName:aa268f72-1dcd-4309-a848-89d7d2eda928 nodeName:}" failed. No retries permitted until 2026-07-08 19:09:53.481675034 +0000 UTC m=+492.172666534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert") pod "maas-controller-dbc8c7466-qlhg4" (UID: "aa268f72-1dcd-4309-a848-89d7d2eda928") : secret "maas-controller-webhook-cert" not found Jul 08 19:09:52.989470 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:52.989450 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hl5v\" (UniqueName: \"kubernetes.io/projected/aa268f72-1dcd-4309-a848-89d7d2eda928-kube-api-access-8hl5v\") pod \"maas-controller-dbc8c7466-qlhg4\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:53.082313 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.082196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65bj\" (UniqueName: \"kubernetes.io/projected/a84c36ba-3dca-47f6-892d-453d6fc5be14-kube-api-access-n65bj\") pod \"maas-controller-6d775d5cc6-c8ztc\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:53.082313 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.082257 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert\") pod \"maas-controller-6d775d5cc6-c8ztc\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:53.183198 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.183157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n65bj\" (UniqueName: \"kubernetes.io/projected/a84c36ba-3dca-47f6-892d-453d6fc5be14-kube-api-access-n65bj\") pod \"maas-controller-6d775d5cc6-c8ztc\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:53.183198 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.183196 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert\") pod \"maas-controller-6d775d5cc6-c8ztc\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:53.183457 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:09:53.183320 2560 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 08 19:09:53.183457 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:09:53.183372 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert podName:a84c36ba-3dca-47f6-892d-453d6fc5be14 nodeName:}" failed. No retries permitted until 2026-07-08 19:09:53.683357904 +0000 UTC m=+492.374349407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert") pod "maas-controller-6d775d5cc6-c8ztc" (UID: "a84c36ba-3dca-47f6-892d-453d6fc5be14") : secret "maas-controller-webhook-cert" not found Jul 08 19:09:53.192174 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.192137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65bj\" (UniqueName: \"kubernetes.io/projected/a84c36ba-3dca-47f6-892d-453d6fc5be14-kube-api-access-n65bj\") pod \"maas-controller-6d775d5cc6-c8ztc\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:53.486069 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.486036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert\") pod \"maas-controller-dbc8c7466-qlhg4\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:53.488692 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.488662 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert\") pod \"maas-controller-dbc8c7466-qlhg4\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:53.687912 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.687870 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert\") pod \"maas-controller-6d775d5cc6-c8ztc\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:53.690535 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.690502 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert\") pod \"maas-controller-6d775d5cc6-c8ztc\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:53.716543 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.716504 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:53.859184 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.859150 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbc8c7466-qlhg4"] Jul 08 19:09:53.861062 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:09:53.861034 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa268f72_1dcd_4309_a848_89d7d2eda928.slice/crio-bee3b7d476e1dd3389818fb3d366ac7da0a1bf2a2eb8b7dc2b5f3c0cc1c30ee3 WatchSource:0}: Error finding container bee3b7d476e1dd3389818fb3d366ac7da0a1bf2a2eb8b7dc2b5f3c0cc1c30ee3: Status 404 returned error can't find the container with id bee3b7d476e1dd3389818fb3d366ac7da0a1bf2a2eb8b7dc2b5f3c0cc1c30ee3 Jul 08 19:09:53.877676 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:53.877647 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:54.017856 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:54.017821 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-c8ztc"] Jul 08 19:09:54.021493 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:09:54.021465 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84c36ba_3dca_47f6_892d_453d6fc5be14.slice/crio-c89d174cdb70f4a93d3802cd67d26e2371272c977feb5f1baa74f3cbc6c6832a WatchSource:0}: Error finding container c89d174cdb70f4a93d3802cd67d26e2371272c977feb5f1baa74f3cbc6c6832a: Status 404 returned error can't find the container with id c89d174cdb70f4a93d3802cd67d26e2371272c977feb5f1baa74f3cbc6c6832a Jul 08 19:09:54.444304 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:54.444196 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" event={"ID":"a84c36ba-3dca-47f6-892d-453d6fc5be14","Type":"ContainerStarted","Data":"c89d174cdb70f4a93d3802cd67d26e2371272c977feb5f1baa74f3cbc6c6832a"} Jul 08 19:09:54.445986 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:54.445947 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" event={"ID":"aa268f72-1dcd-4309-a848-89d7d2eda928","Type":"ContainerStarted","Data":"bee3b7d476e1dd3389818fb3d366ac7da0a1bf2a2eb8b7dc2b5f3c0cc1c30ee3"} Jul 08 19:09:56.461311 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:56.461196 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" event={"ID":"a84c36ba-3dca-47f6-892d-453d6fc5be14","Type":"ContainerStarted","Data":"048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6"} Jul 08 19:09:56.461311 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:56.461275 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:09:56.463065 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:56.463032 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" event={"ID":"aa268f72-1dcd-4309-a848-89d7d2eda928","Type":"ContainerStarted","Data":"6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50"} Jul 08 19:09:56.463211 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:56.463090 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:09:56.478984 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:56.478920 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" podStartSLOduration=2.123401541 podStartE2EDuration="4.478901186s" totalImagesPullingTime="2.355499645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:56.476552112 +0000 UTC m=+495.167543634" watchObservedRunningTime="2026-07-08 19:09:56.478901186 +0000 UTC m=+495.169892708" Jul 08 19:09:56.491931 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:09:56.491861 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" podStartSLOduration=1.9871659670000001 podStartE2EDuration="4.491838025s" totalImagesPullingTime="2.504672058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:09:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:09:56.490888889 +0000 UTC m=+495.181880411" watchObservedRunningTime="2026-07-08 19:09:56.491838025 +0000 UTC m=+495.182829549" Jul 08 19:10:07.477440 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.477408 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:10:07.477855 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.477484 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:10:07.533520 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.533479 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dbc8c7466-qlhg4"] Jul 08 19:10:07.533741 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.533715 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" podUID="aa268f72-1dcd-4309-a848-89d7d2eda928" containerName="manager" containerID="cri-o://6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50" gracePeriod=30 Jul 08 19:10:07.780564 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.780540 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:10:07.819834 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.819740 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hl5v\" (UniqueName: \"kubernetes.io/projected/aa268f72-1dcd-4309-a848-89d7d2eda928-kube-api-access-8hl5v\") pod \"aa268f72-1dcd-4309-a848-89d7d2eda928\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " Jul 08 19:10:07.820005 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.819895 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert\") pod \"aa268f72-1dcd-4309-a848-89d7d2eda928\" (UID: \"aa268f72-1dcd-4309-a848-89d7d2eda928\") " Jul 08 19:10:07.822110 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.822081 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "aa268f72-1dcd-4309-a848-89d7d2eda928" (UID: "aa268f72-1dcd-4309-a848-89d7d2eda928"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:10:07.822194 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.822133 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa268f72-1dcd-4309-a848-89d7d2eda928-kube-api-access-8hl5v" (OuterVolumeSpecName: "kube-api-access-8hl5v") pod "aa268f72-1dcd-4309-a848-89d7d2eda928" (UID: "aa268f72-1dcd-4309-a848-89d7d2eda928"). InnerVolumeSpecName "kube-api-access-8hl5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:10:07.920911 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.920869 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hl5v\" (UniqueName: \"kubernetes.io/projected/aa268f72-1dcd-4309-a848-89d7d2eda928-kube-api-access-8hl5v\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:10:07.920911 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:07.920903 2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa268f72-1dcd-4309-a848-89d7d2eda928-webhook-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:10:08.534037 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.534002 2560 generic.go:356] "Generic (PLEG): container finished" podID="aa268f72-1dcd-4309-a848-89d7d2eda928" containerID="6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50" exitCode=0 Jul 08 19:10:08.534466 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.534047 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" Jul 08 19:10:08.534466 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.534087 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" event={"ID":"aa268f72-1dcd-4309-a848-89d7d2eda928","Type":"ContainerDied","Data":"6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50"} Jul 08 19:10:08.534466 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.534145 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbc8c7466-qlhg4" event={"ID":"aa268f72-1dcd-4309-a848-89d7d2eda928","Type":"ContainerDied","Data":"bee3b7d476e1dd3389818fb3d366ac7da0a1bf2a2eb8b7dc2b5f3c0cc1c30ee3"} Jul 08 19:10:08.534466 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.534169 2560 scope.go:117] "RemoveContainer" containerID="6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50" Jul 08 19:10:08.543626 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.543603 2560 scope.go:117] "RemoveContainer" containerID="6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50" Jul 08 19:10:08.543944 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:10:08.543924 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50\": container with ID starting with 6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50 not found: ID does not exist" containerID="6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50" Jul 08 19:10:08.544013 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.543955 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50"} err="failed to get container status \"6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50\": rpc error: code = NotFound desc = could not find container \"6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50\": container with ID starting with 6930fbc3ff22de59f6844d969c7717fe87665177feacc681a31f55b3cfbfdd50 not found: ID does not exist" Jul 08 19:10:08.550059 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.550028 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dbc8c7466-qlhg4"] Jul 08 19:10:08.553515 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:08.553490 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dbc8c7466-qlhg4"] Jul 08 19:10:09.964740 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:09.964703 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa268f72-1dcd-4309-a848-89d7d2eda928" path="/var/lib/kubelet/pods/aa268f72-1dcd-4309-a848-89d7d2eda928/volumes" Jul 08 19:10:27.246959 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.246922 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k"] Jul 08 19:10:27.247424 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.247288 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa268f72-1dcd-4309-a848-89d7d2eda928" containerName="manager" Jul 08 19:10:27.247424 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.247299 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa268f72-1dcd-4309-a848-89d7d2eda928" containerName="manager" Jul 08 19:10:27.247424 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.247358 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa268f72-1dcd-4309-a848-89d7d2eda928" containerName="manager" Jul 08 19:10:27.251707 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.251687 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.253863 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.253840 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4s497\"" Jul 08 19:10:27.253994 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.253844 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 08 19:10:27.260856 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.260832 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k"] Jul 08 19:10:27.399289 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.399244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfhfp\" (UniqueName: \"kubernetes.io/projected/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-kube-api-access-mfhfp\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.399289 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.399290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-openshift-service-ca\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.399563 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.399427 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-maas-api-tls\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.500232 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.500144 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfhfp\" (UniqueName: \"kubernetes.io/projected/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-kube-api-access-mfhfp\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.500232 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.500181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-openshift-service-ca\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.500232 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.500220 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-maas-api-tls\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.500951 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.500932 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-openshift-service-ca\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.502968 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.502949 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-maas-api-tls\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.508331 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.508308 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfhfp\" (UniqueName: \"kubernetes.io/projected/5a9f4880-4a4c-43b2-8162-39295ec6f5e4-kube-api-access-mfhfp\") pod \"maas-api-7dc4dff44d-5lg2k\" (UID: \"5a9f4880-4a4c-43b2-8162-39295ec6f5e4\") " pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.564178 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.564136 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:27.716749 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.716719 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k"] Jul 08 19:10:27.719582 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:10:27.719544 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9f4880_4a4c_43b2_8162_39295ec6f5e4.slice/crio-4f5fc5a928393fe270bc5cfd688a9cc62fa7e935f96bc079b5fa065557115dcf WatchSource:0}: Error finding container 4f5fc5a928393fe270bc5cfd688a9cc62fa7e935f96bc079b5fa065557115dcf: Status 404 returned error can't find the container with id 4f5fc5a928393fe270bc5cfd688a9cc62fa7e935f96bc079b5fa065557115dcf Jul 08 19:10:27.916539 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.916461 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-b2d5b"] Jul 08 19:10:27.921370 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.921344 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:27.923332 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.923307 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 19:10:27.923492 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.923307 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hp9lv\"" Jul 08 19:10:27.928499 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:27.928475 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-b2d5b"] Jul 08 19:10:28.005365 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.005333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj4js\" (UniqueName: \"kubernetes.io/projected/b0a8c4ce-b6f8-4086-b1d3-11528367630c-kube-api-access-zj4js\") pod \"payload-processing-58f86c7798-b2d5b\" (UID: \"b0a8c4ce-b6f8-4086-b1d3-11528367630c\") " pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:28.005570 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.005369 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0a8c4ce-b6f8-4086-b1d3-11528367630c-plugins-config-volume\") pod \"payload-processing-58f86c7798-b2d5b\" (UID: \"b0a8c4ce-b6f8-4086-b1d3-11528367630c\") " pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:28.106400 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.106361 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj4js\" (UniqueName: \"kubernetes.io/projected/b0a8c4ce-b6f8-4086-b1d3-11528367630c-kube-api-access-zj4js\") pod \"payload-processing-58f86c7798-b2d5b\" (UID: \"b0a8c4ce-b6f8-4086-b1d3-11528367630c\") " pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:28.106632 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.106436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0a8c4ce-b6f8-4086-b1d3-11528367630c-plugins-config-volume\") pod \"payload-processing-58f86c7798-b2d5b\" (UID: \"b0a8c4ce-b6f8-4086-b1d3-11528367630c\") " pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:28.107210 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.107187 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b0a8c4ce-b6f8-4086-b1d3-11528367630c-plugins-config-volume\") pod \"payload-processing-58f86c7798-b2d5b\" (UID: \"b0a8c4ce-b6f8-4086-b1d3-11528367630c\") " pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:28.114026 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.113991 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj4js\" (UniqueName: \"kubernetes.io/projected/b0a8c4ce-b6f8-4086-b1d3-11528367630c-kube-api-access-zj4js\") pod \"payload-processing-58f86c7798-b2d5b\" (UID: \"b0a8c4ce-b6f8-4086-b1d3-11528367630c\") " pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:28.234535 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.234503 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:28.380568 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.380538 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-b2d5b"] Jul 08 19:10:28.383648 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:10:28.383612 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a8c4ce_b6f8_4086_b1d3_11528367630c.slice/crio-02fd9f1ef40e8cef7d25d93c00623af2c72520cb908bb8c6f7efcd305aa39dc3 WatchSource:0}: Error finding container 02fd9f1ef40e8cef7d25d93c00623af2c72520cb908bb8c6f7efcd305aa39dc3: Status 404 returned error can't find the container with id 02fd9f1ef40e8cef7d25d93c00623af2c72520cb908bb8c6f7efcd305aa39dc3 Jul 08 19:10:28.654116 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.653925 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" event={"ID":"b0a8c4ce-b6f8-4086-b1d3-11528367630c","Type":"ContainerStarted","Data":"02fd9f1ef40e8cef7d25d93c00623af2c72520cb908bb8c6f7efcd305aa39dc3"} Jul 08 19:10:28.655363 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:28.655327 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" event={"ID":"5a9f4880-4a4c-43b2-8162-39295ec6f5e4","Type":"ContainerStarted","Data":"4f5fc5a928393fe270bc5cfd688a9cc62fa7e935f96bc079b5fa065557115dcf"} Jul 08 19:10:30.680423 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:30.680370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" event={"ID":"b0a8c4ce-b6f8-4086-b1d3-11528367630c","Type":"ContainerStarted","Data":"53252cdbe1b33e0740b6955cd8341cf8e88aec570d641afdf5a506f94b6169df"} Jul 08 19:10:30.680942 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:30.680529 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:30.681908 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:30.681882 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" event={"ID":"5a9f4880-4a4c-43b2-8162-39295ec6f5e4","Type":"ContainerStarted","Data":"7242ff7a81007204a26edd1db905156b307e14c40cad792dd42758a7c69f9263"} Jul 08 19:10:30.682018 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:30.681935 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:30.698946 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:30.698896 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" podStartSLOduration=2.060585378 podStartE2EDuration="3.698873818s" totalImagesPullingTime="1.63828844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:10:30.695936139 +0000 UTC m=+529.386927661" watchObservedRunningTime="2026-07-08 19:10:30.698873818 +0000 UTC m=+529.389865340" Jul 08 19:10:30.710738 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:30.710675 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" podStartSLOduration=1.409456573 podStartE2EDuration="3.710653621s" totalImagesPullingTime="2.301197048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:10:30.709350373 +0000 UTC m=+529.400341894" watchObservedRunningTime="2026-07-08 19:10:30.710653621 +0000 UTC m=+529.401645172" Jul 08 19:10:36.693002 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:36.692911 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7dc4dff44d-5lg2k" Jul 08 19:10:41.689632 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:41.689596 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-b2d5b" Jul 08 19:10:47.464870 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.464833 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2"] Jul 08 19:10:47.469559 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.469539 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.471975 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.471950 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-r6kqj\"" Jul 08 19:10:47.472099 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.471950 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 19:10:47.472099 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.471950 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 08 19:10:47.472099 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.472014 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 19:10:47.475750 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.475725 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.475949 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.475929 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfk88\" (UniqueName: \"kubernetes.io/projected/03af5e0d-203f-47e8-be08-6e7a7d5cc485-kube-api-access-rfk88\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.476117 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.476092 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03af5e0d-203f-47e8-be08-6e7a7d5cc485-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.476210 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.476130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.476210 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.476161 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.476292 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.476214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.476708 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.476693 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2"] Jul 08 19:10:47.577023 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.576985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.577023 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.577029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.577263 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.577065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.577263 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.577125 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.577263 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.577245 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfk88\" (UniqueName: \"kubernetes.io/projected/03af5e0d-203f-47e8-be08-6e7a7d5cc485-kube-api-access-rfk88\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.577376 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.577322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03af5e0d-203f-47e8-be08-6e7a7d5cc485-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.577508 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.577487 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.577575 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.577552 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.577642 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.577589 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.579503 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.579473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03af5e0d-203f-47e8-be08-6e7a7d5cc485-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.579840 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.579824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03af5e0d-203f-47e8-be08-6e7a7d5cc485-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.585312 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.585289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfk88\" (UniqueName: \"kubernetes.io/projected/03af5e0d-203f-47e8-be08-6e7a7d5cc485-kube-api-access-rfk88\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2\" (UID: \"03af5e0d-203f-47e8-be08-6e7a7d5cc485\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.780827 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.780788 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:47.925143 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:47.925113 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2"] Jul 08 19:10:47.927214 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:10:47.927187 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03af5e0d_203f_47e8_be08_6e7a7d5cc485.slice/crio-e8c6b5d40c53954e94d167194d716426729a87243e65db4f6189f13587916c2b WatchSource:0}: Error finding container e8c6b5d40c53954e94d167194d716426729a87243e65db4f6189f13587916c2b: Status 404 returned error can't find the container with id e8c6b5d40c53954e94d167194d716426729a87243e65db4f6189f13587916c2b Jul 08 19:10:48.784452 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:48.784420 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" event={"ID":"03af5e0d-203f-47e8-be08-6e7a7d5cc485","Type":"ContainerStarted","Data":"e8c6b5d40c53954e94d167194d716426729a87243e65db4f6189f13587916c2b"} Jul 08 19:10:49.791769 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:49.791729 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" event={"ID":"03af5e0d-203f-47e8-be08-6e7a7d5cc485","Type":"ContainerStarted","Data":"363dcd324bd9a0545567849cdbd31a3b7d35fd64bb23aa93d7c3336f6d977d17"} Jul 08 19:10:49.809579 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:49.809516 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" podStartSLOduration=1.587254555 podStartE2EDuration="2.809498591s" totalImagesPullingTime="1.222244036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:10:49.807685551 +0000 UTC m=+548.498677071" watchObservedRunningTime="2026-07-08 19:10:49.809498591 +0000 UTC m=+548.500490114" Jul 08 19:10:57.781742 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:57.781701 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:57.782253 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:57.781771 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:57.795269 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:57.795239 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:10:57.852979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:10:57.852939 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2" Jul 08 19:11:17.552699 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.552664 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt"] Jul 08 19:11:17.555519 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.555489 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.557358 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.557337 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 19:11:17.567499 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.567473 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt"] Jul 08 19:11:17.655678 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.655640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.655678 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.655681 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9xb6\" (UniqueName: \"kubernetes.io/projected/7c37d24c-3b7d-46cd-8de9-b562331f2974-kube-api-access-d9xb6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.655964 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.655801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.655964 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.655841 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c37d24c-3b7d-46cd-8de9-b562331f2974-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.655964 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.655883 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.655964 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.655944 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.757443 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757405 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.757647 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757458 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.757647 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757484 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9xb6\" (UniqueName: \"kubernetes.io/projected/7c37d24c-3b7d-46cd-8de9-b562331f2974-kube-api-access-d9xb6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.757647 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757540 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.757647 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757556 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c37d24c-3b7d-46cd-8de9-b562331f2974-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.757647 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.757927 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757898 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.757978 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757925 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.758015 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.757987 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.760110 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.760085 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c37d24c-3b7d-46cd-8de9-b562331f2974-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.760241 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.760224 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c37d24c-3b7d-46cd-8de9-b562331f2974-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.766330 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.766304 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9xb6\" (UniqueName: \"kubernetes.io/projected/7c37d24c-3b7d-46cd-8de9-b562331f2974-kube-api-access-d9xb6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-shqrt\" (UID: \"7c37d24c-3b7d-46cd-8de9-b562331f2974\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:17.867021 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:17.866924 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:18.023830 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:18.023803 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt"] Jul 08 19:11:18.025982 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:11:18.025953 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c37d24c_3b7d_46cd_8de9_b562331f2974.slice/crio-90282b9677c3e26e2d5e2f4f0e22950fb0c9b7ef968286cb23b1725260608647 WatchSource:0}: Error finding container 90282b9677c3e26e2d5e2f4f0e22950fb0c9b7ef968286cb23b1725260608647: Status 404 returned error can't find the container with id 90282b9677c3e26e2d5e2f4f0e22950fb0c9b7ef968286cb23b1725260608647 Jul 08 19:11:18.949255 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:18.949216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" event={"ID":"7c37d24c-3b7d-46cd-8de9-b562331f2974","Type":"ContainerStarted","Data":"03cc30f6e5f1c8dd47fa243be35324d6f74dff6a117fb320176d4dde6e628e2d"} Jul 08 19:11:18.949755 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:18.949304 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" event={"ID":"7c37d24c-3b7d-46cd-8de9-b562331f2974","Type":"ContainerStarted","Data":"90282b9677c3e26e2d5e2f4f0e22950fb0c9b7ef968286cb23b1725260608647"} Jul 08 19:11:18.970152 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:18.970097 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" podStartSLOduration=1.804195714 podStartE2EDuration="1.970079913s" totalImagesPullingTime="165.884199ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:11:18.967796854 +0000 UTC m=+577.658788379" watchObservedRunningTime="2026-07-08 19:11:18.970079913 +0000 UTC m=+577.661071435" Jul 08 19:11:27.867466 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:27.867425 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:27.867942 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:27.867490 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:27.880334 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:27.880307 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:11:28.009501 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:11:28.009468 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-shqrt" Jul 08 19:14:14.572498 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.572458 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-c8ztc"] Jul 08 19:14:14.573770 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.573735 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" podUID="a84c36ba-3dca-47f6-892d-453d6fc5be14" containerName="manager" containerID="cri-o://048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6" gracePeriod=30 Jul 08 19:14:14.836951 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.836884 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:14:14.907026 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.906995 2560 generic.go:356] "Generic (PLEG): container finished" podID="a84c36ba-3dca-47f6-892d-453d6fc5be14" containerID="048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6" exitCode=0 Jul 08 19:14:14.907236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.907053 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" Jul 08 19:14:14.907236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.907087 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" event={"ID":"a84c36ba-3dca-47f6-892d-453d6fc5be14","Type":"ContainerDied","Data":"048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6"} Jul 08 19:14:14.907236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.907176 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d775d5cc6-c8ztc" event={"ID":"a84c36ba-3dca-47f6-892d-453d6fc5be14","Type":"ContainerDied","Data":"c89d174cdb70f4a93d3802cd67d26e2371272c977feb5f1baa74f3cbc6c6832a"} Jul 08 19:14:14.907236 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.907200 2560 scope.go:117] "RemoveContainer" containerID="048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6" Jul 08 19:14:14.916345 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.916327 2560 scope.go:117] "RemoveContainer" containerID="048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6" Jul 08 19:14:14.916745 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:14:14.916718 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6\": container with ID starting with 048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6 not found: ID does not exist" containerID="048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6" Jul 08 19:14:14.916836 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.916752 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6"} err="failed to get container status \"048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6\": rpc error: code = NotFound desc = could not find container \"048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6\": container with ID starting with 048d49a496adb8da280d3a031ff5a36a317cac32b7869be07f518ed1cbaa8af6 not found: ID does not exist" Jul 08 19:14:14.925220 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.925199 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n65bj\" (UniqueName: \"kubernetes.io/projected/a84c36ba-3dca-47f6-892d-453d6fc5be14-kube-api-access-n65bj\") pod \"a84c36ba-3dca-47f6-892d-453d6fc5be14\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " Jul 08 19:14:14.925310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.925245 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert\") pod \"a84c36ba-3dca-47f6-892d-453d6fc5be14\" (UID: \"a84c36ba-3dca-47f6-892d-453d6fc5be14\") " Jul 08 19:14:14.927542 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.927513 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a84c36ba-3dca-47f6-892d-453d6fc5be14" (UID: "a84c36ba-3dca-47f6-892d-453d6fc5be14"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:14:14.927542 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:14.927527 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84c36ba-3dca-47f6-892d-453d6fc5be14-kube-api-access-n65bj" (OuterVolumeSpecName: "kube-api-access-n65bj") pod "a84c36ba-3dca-47f6-892d-453d6fc5be14" (UID: "a84c36ba-3dca-47f6-892d-453d6fc5be14"). InnerVolumeSpecName "kube-api-access-n65bj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:14:15.026560 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:15.026528 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n65bj\" (UniqueName: \"kubernetes.io/projected/a84c36ba-3dca-47f6-892d-453d6fc5be14-kube-api-access-n65bj\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:14:15.026560 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:15.026554 2560 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a84c36ba-3dca-47f6-892d-453d6fc5be14-webhook-cert\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:14:15.230083 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:15.230046 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-c8ztc"] Jul 08 19:14:15.233213 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:15.233183 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-c8ztc"] Jul 08 19:14:15.960030 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:15.959992 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a84c36ba-3dca-47f6-892d-453d6fc5be14" path="/var/lib/kubelet/pods/a84c36ba-3dca-47f6-892d-453d6fc5be14/volumes" Jul 08 19:14:16.033924 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.033891 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-ljwjc"] Jul 08 19:14:16.034293 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.034278 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84c36ba-3dca-47f6-892d-453d6fc5be14" containerName="manager" Jul 08 19:14:16.034293 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.034293 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84c36ba-3dca-47f6-892d-453d6fc5be14" containerName="manager" Jul 08 19:14:16.034501 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.034366 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84c36ba-3dca-47f6-892d-453d6fc5be14" containerName="manager" Jul 08 19:14:16.038970 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.038952 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:16.041265 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.041242 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 19:14:16.041377 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.041243 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 19:14:16.041377 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.041279 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zdrct\"" Jul 08 19:14:16.047258 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.047237 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-ljwjc"] Jul 08 19:14:16.137123 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.137085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5-webhook-cert\") pod \"maas-controller-6d775d5cc6-ljwjc\" (UID: \"1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5\") " pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:16.137294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.137139 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxx5h\" (UniqueName: \"kubernetes.io/projected/1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5-kube-api-access-cxx5h\") pod \"maas-controller-6d775d5cc6-ljwjc\" (UID: \"1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5\") " pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:16.238015 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.237975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5-webhook-cert\") pod \"maas-controller-6d775d5cc6-ljwjc\" (UID: \"1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5\") " pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:16.238209 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.238031 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxx5h\" (UniqueName: \"kubernetes.io/projected/1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5-kube-api-access-cxx5h\") pod \"maas-controller-6d775d5cc6-ljwjc\" (UID: \"1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5\") " pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:16.240752 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.240728 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5-webhook-cert\") pod \"maas-controller-6d775d5cc6-ljwjc\" (UID: \"1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5\") " pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:16.246683 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.246659 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxx5h\" (UniqueName: \"kubernetes.io/projected/1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5-kube-api-access-cxx5h\") pod \"maas-controller-6d775d5cc6-ljwjc\" (UID: \"1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5\") " pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:16.350535 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.350505 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:16.492883 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.492802 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d775d5cc6-ljwjc"] Jul 08 19:14:16.496094 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:14:16.496052 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7f52f0_05a1_4d38_a120_1ffd3bc8d6e5.slice/crio-1382b83a1f6865c4530d88961fceb86edf2a7ae8a6f8517fd6b225f6a1fa6bb5 WatchSource:0}: Error finding container 1382b83a1f6865c4530d88961fceb86edf2a7ae8a6f8517fd6b225f6a1fa6bb5: Status 404 returned error can't find the container with id 1382b83a1f6865c4530d88961fceb86edf2a7ae8a6f8517fd6b225f6a1fa6bb5 Jul 08 19:14:16.497649 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.497627 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:14:16.921195 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:16.921105 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" event={"ID":"1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5","Type":"ContainerStarted","Data":"1382b83a1f6865c4530d88961fceb86edf2a7ae8a6f8517fd6b225f6a1fa6bb5"} Jul 08 19:14:17.928162 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:17.928124 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" event={"ID":"1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5","Type":"ContainerStarted","Data":"c1ee725b475ae7ef2546b00f1bf508c9541e0894c588517970f6455c71ced72c"} Jul 08 19:14:17.928587 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:17.928196 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:14:17.944338 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:17.944288 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" podStartSLOduration=1.454464897 podStartE2EDuration="1.944270463s" totalImagesPullingTime="489.805566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:14:17.943187751 +0000 UTC m=+756.634179276" watchObservedRunningTime="2026-07-08 19:14:17.944270463 +0000 UTC m=+756.635261984" Jul 08 19:14:28.936609 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:14:28.936579 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d775d5cc6-ljwjc" Jul 08 19:26:32.844173 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:32.844134 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z"] Jul 08 19:26:32.848016 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:32.847991 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:32.850126 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:32.850102 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-16aad909-serving-cert\"" Jul 08 19:26:32.859125 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:32.859099 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z"] Jul 08 19:26:32.983202 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:32.983174 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:32.983442 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:32.983219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d457j\" (UniqueName: \"kubernetes.io/projected/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-kube-api-access-d457j\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:32.983442 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:32.983241 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-openshift-service-ca\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.084126 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.084093 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.084336 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.084164 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d457j\" (UniqueName: \"kubernetes.io/projected/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-kube-api-access-d457j\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.084336 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.084186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-openshift-service-ca\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.084516 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:26:33.084412 2560 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-serving-cert: secret "maas-api-e2e-ait-16aad909-serving-cert" not found Jul 08 19:26:33.084566 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:26:33.084522 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls podName:83bc6f06-bb7d-4870-b5a1-800dcc3b642c nodeName:}" failed. No retries permitted until 2026-07-08 19:26:33.584499673 +0000 UTC m=+1492.275491175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls") pod "maas-api-e2e-ait-16aad909-667689df6b-jdd4z" (UID: "83bc6f06-bb7d-4870-b5a1-800dcc3b642c") : secret "maas-api-e2e-ait-16aad909-serving-cert" not found Jul 08 19:26:33.084979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.084959 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-openshift-service-ca\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.094582 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.094515 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d457j\" (UniqueName: \"kubernetes.io/projected/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-kube-api-access-d457j\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.589120 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.589075 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.591908 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.591880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls\") pod \"maas-api-e2e-ait-16aad909-667689df6b-jdd4z\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.759552 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.759507 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:33.914872 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:26:33.914840 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bc6f06_bb7d_4870_b5a1_800dcc3b642c.slice/crio-ed45f1c6414bebce344033a73fdf27781c7542f0add0e8f00c97c084bd530545 WatchSource:0}: Error finding container ed45f1c6414bebce344033a73fdf27781c7542f0add0e8f00c97c084bd530545: Status 404 returned error can't find the container with id ed45f1c6414bebce344033a73fdf27781c7542f0add0e8f00c97c084bd530545 Jul 08 19:26:33.915241 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.914907 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z"] Jul 08 19:26:33.916740 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.916718 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:26:33.989280 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:33.989238 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" event={"ID":"83bc6f06-bb7d-4870-b5a1-800dcc3b642c","Type":"ContainerStarted","Data":"ed45f1c6414bebce344033a73fdf27781c7542f0add0e8f00c97c084bd530545"} Jul 08 19:26:34.997000 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:34.996962 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" event={"ID":"83bc6f06-bb7d-4870-b5a1-800dcc3b642c","Type":"ContainerStarted","Data":"8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9"} Jul 08 19:26:34.997428 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:34.997026 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:26:35.014620 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:35.014554 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" podStartSLOduration=2.5377453819999998 podStartE2EDuration="3.014536096s" totalImagesPullingTime="476.790714ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:26:35.013098848 +0000 UTC m=+1493.704090371" watchObservedRunningTime="2026-07-08 19:26:35.014536096 +0000 UTC m=+1493.705527617" Jul 08 19:26:41.007641 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:26:41.007611 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:27:44.341968 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.341927 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z"] Jul 08 19:27:44.342446 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.342188 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" podUID="83bc6f06-bb7d-4870-b5a1-800dcc3b642c" containerName="maas-api" containerID="cri-o://8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9" gracePeriod=30 Jul 08 19:27:44.599024 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.598992 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:27:44.669526 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.669482 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls\") pod \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " Jul 08 19:27:44.669719 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.669556 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d457j\" (UniqueName: \"kubernetes.io/projected/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-kube-api-access-d457j\") pod \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " Jul 08 19:27:44.669719 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.669615 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-openshift-service-ca\") pod \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\" (UID: \"83bc6f06-bb7d-4870-b5a1-800dcc3b642c\") " Jul 08 19:27:44.669979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.669959 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83bc6f06-bb7d-4870-b5a1-800dcc3b642c" (UID: "83bc6f06-bb7d-4870-b5a1-800dcc3b642c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:27:44.672008 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.671982 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83bc6f06-bb7d-4870-b5a1-800dcc3b642c" (UID: "83bc6f06-bb7d-4870-b5a1-800dcc3b642c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:27:44.672103 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.672007 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-kube-api-access-d457j" (OuterVolumeSpecName: "kube-api-access-d457j") pod "83bc6f06-bb7d-4870-b5a1-800dcc3b642c" (UID: "83bc6f06-bb7d-4870-b5a1-800dcc3b642c"). InnerVolumeSpecName "kube-api-access-d457j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:27:44.770598 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.770561 2560 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-maas-api-tls\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:27:44.770598 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.770592 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d457j\" (UniqueName: \"kubernetes.io/projected/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-kube-api-access-d457j\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:27:44.770598 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:44.770604 2560 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83bc6f06-bb7d-4870-b5a1-800dcc3b642c-openshift-service-ca\") on node \"ip-10-0-129-210.ec2.internal\" DevicePath \"\"" Jul 08 19:27:45.394614 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.394574 2560 generic.go:356] "Generic (PLEG): container finished" podID="83bc6f06-bb7d-4870-b5a1-800dcc3b642c" containerID="8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9" exitCode=0 Jul 08 19:27:45.395005 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.394618 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" Jul 08 19:27:45.395005 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.394659 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" event={"ID":"83bc6f06-bb7d-4870-b5a1-800dcc3b642c","Type":"ContainerDied","Data":"8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9"} Jul 08 19:27:45.395005 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.394717 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z" event={"ID":"83bc6f06-bb7d-4870-b5a1-800dcc3b642c","Type":"ContainerDied","Data":"ed45f1c6414bebce344033a73fdf27781c7542f0add0e8f00c97c084bd530545"} Jul 08 19:27:45.395005 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.394746 2560 scope.go:117] "RemoveContainer" containerID="8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9" Jul 08 19:27:45.404541 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.404521 2560 scope.go:117] "RemoveContainer" containerID="8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9" Jul 08 19:27:45.404840 ip-10-0-129-210 kubenswrapper[2560]: E0708 19:27:45.404820 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9\": container with ID starting with 8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9 not found: ID does not exist" containerID="8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9" Jul 08 19:27:45.404890 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.404850 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9"} err="failed to get container status \"8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9\": rpc error: code = NotFound desc = could not find container \"8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9\": container with ID starting with 8bc01e8a7aed449090acc9a3e3900172c152e989ce5f953b8a87ff86c6e8c8e9 not found: ID does not exist" Jul 08 19:27:45.418637 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.418611 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z"] Jul 08 19:27:45.424816 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.424782 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16aad909-667689df6b-jdd4z"] Jul 08 19:27:45.959362 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:27:45.959317 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83bc6f06-bb7d-4870-b5a1-800dcc3b642c" path="/var/lib/kubelet/pods/83bc6f06-bb7d-4870-b5a1-800dcc3b642c/volumes" Jul 08 19:45:22.669564 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:22.669531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d775d5cc6-ljwjc_1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5/manager/0.log" Jul 08 19:45:23.205289 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:23.205260 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-l9q96_2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09/copy-manifests/0.log" Jul 08 19:45:23.212872 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:23.212847 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-l9q96_2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09/manager/0.log" Jul 08 19:45:24.263417 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.263359 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl_367f68f0-bb95-4ba6-8548-2087c768ca21/util/0.log" Jul 08 19:45:24.270450 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.270423 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl_367f68f0-bb95-4ba6-8548-2087c768ca21/pull/0.log" Jul 08 19:45:24.276987 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.276959 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl_367f68f0-bb95-4ba6-8548-2087c768ca21/extract/0.log" Jul 08 19:45:24.410287 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.410253 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92_afc71143-44f8-4192-b1e8-b46f172f070f/pull/0.log" Jul 08 19:45:24.417131 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.417100 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92_afc71143-44f8-4192-b1e8-b46f172f070f/extract/0.log" Jul 08 19:45:24.423636 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.423610 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92_afc71143-44f8-4192-b1e8-b46f172f070f/util/0.log" Jul 08 19:45:24.550300 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.550221 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk_eeb90f18-54e2-44ae-b754-ad1f817f3c6a/util/0.log" Jul 08 19:45:24.557727 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.557698 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk_eeb90f18-54e2-44ae-b754-ad1f817f3c6a/pull/0.log" Jul 08 19:45:24.564753 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.564728 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk_eeb90f18-54e2-44ae-b754-ad1f817f3c6a/extract/0.log" Jul 08 19:45:24.690782 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.690755 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r_e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d/extract/0.log" Jul 08 19:45:24.697313 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.697288 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r_e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d/util/0.log" Jul 08 19:45:24.704258 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:24.704236 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r_e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d/pull/0.log" Jul 08 19:45:25.096413 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:25.096356 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nbhwb_d4001106-9ad2-4a62-a3e0-fc2e1f52ad58/manager/0.log" Jul 08 19:45:26.279929 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:26.279897 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-85nc8_369a4f7c-112c-448f-ba73-f7a26b81a3f3/discovery/0.log" Jul 08 19:45:26.903756 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:26.903720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-b2d5b_b0a8c4ce-b6f8-4086-b1d3-11528367630c/payload-processing/0.log" Jul 08 19:45:27.397622 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:27.397580 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wsmc2_03af5e0d-203f-47e8-be08-6e7a7d5cc485/main/0.log" Jul 08 19:45:27.877131 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:27.877095 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-shqrt_7c37d24c-3b7d-46cd-8de9-b562331f2974/main/0.log" Jul 08 19:45:35.559927 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:35.559888 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2h4tw_4cc34c95-fd99-488a-9325-4056ffe2c48a/global-pull-secret-syncer/0.log" Jul 08 19:45:35.760261 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:35.760231 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cdphm_668651a4-1aee-4e06-bae1-f9db7d554099/konnectivity-agent/0.log" Jul 08 19:45:35.867244 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:35.867156 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-210.ec2.internal_39f89880c7f4aecc1e0e5b84b9c26123/haproxy/0.log" Jul 08 19:45:40.443566 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.443527 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl_367f68f0-bb95-4ba6-8548-2087c768ca21/extract/0.log" Jul 08 19:45:40.468488 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.468457 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl_367f68f0-bb95-4ba6-8548-2087c768ca21/util/0.log" Jul 08 19:45:40.497234 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.497207 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592rdnl_367f68f0-bb95-4ba6-8548-2087c768ca21/pull/0.log" Jul 08 19:45:40.529463 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.529435 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92_afc71143-44f8-4192-b1e8-b46f172f070f/extract/0.log" Jul 08 19:45:40.552863 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.552830 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92_afc71143-44f8-4192-b1e8-b46f172f070f/util/0.log" Jul 08 19:45:40.576623 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.576592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e092k92_afc71143-44f8-4192-b1e8-b46f172f070f/pull/0.log" Jul 08 19:45:40.603477 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.603449 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk_eeb90f18-54e2-44ae-b754-ad1f817f3c6a/extract/0.log" Jul 08 19:45:40.625580 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.625542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk_eeb90f18-54e2-44ae-b754-ad1f817f3c6a/util/0.log" Jul 08 19:45:40.647622 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.647592 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nbmbk_eeb90f18-54e2-44ae-b754-ad1f817f3c6a/pull/0.log" Jul 08 19:45:40.675258 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.675227 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r_e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d/extract/0.log" Jul 08 19:45:40.702235 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.702140 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r_e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d/util/0.log" Jul 08 19:45:40.726642 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:40.726610 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dff2r_e57e3bf8-8672-4057-b1a6-f56f6b8b0d9d/pull/0.log" Jul 08 19:45:41.039582 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:41.039545 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nbhwb_d4001106-9ad2-4a62-a3e0-fc2e1f52ad58/manager/0.log" Jul 08 19:45:43.031693 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.031660 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34e56622-4c7b-4686-b4bf-f9bfcbd11e96/alertmanager/0.log" Jul 08 19:45:43.058397 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.058351 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34e56622-4c7b-4686-b4bf-f9bfcbd11e96/config-reloader/0.log" Jul 08 19:45:43.082097 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.082068 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34e56622-4c7b-4686-b4bf-f9bfcbd11e96/kube-rbac-proxy-web/0.log" Jul 08 19:45:43.106069 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.106041 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34e56622-4c7b-4686-b4bf-f9bfcbd11e96/kube-rbac-proxy/0.log" Jul 08 19:45:43.129941 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.129916 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34e56622-4c7b-4686-b4bf-f9bfcbd11e96/kube-rbac-proxy-metric/0.log" Jul 08 19:45:43.152609 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.152581 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34e56622-4c7b-4686-b4bf-f9bfcbd11e96/prom-label-proxy/0.log" Jul 08 19:45:43.177295 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.177270 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_34e56622-4c7b-4686-b4bf-f9bfcbd11e96/init-config-reloader/0.log" Jul 08 19:45:43.253772 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.253741 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bc2sl_623f6cba-b644-4fc5-8163-07feed641333/kube-state-metrics/0.log" Jul 08 19:45:43.278324 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.278269 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bc2sl_623f6cba-b644-4fc5-8163-07feed641333/kube-rbac-proxy-main/0.log" Jul 08 19:45:43.302259 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.302158 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-bc2sl_623f6cba-b644-4fc5-8163-07feed641333/kube-rbac-proxy-self/0.log" Jul 08 19:45:43.488503 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.488456 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9xfr_e98bd1f1-7515-419e-8625-ea1499f4195b/node-exporter/0.log" Jul 08 19:45:43.507586 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.507562 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9xfr_e98bd1f1-7515-419e-8625-ea1499f4195b/kube-rbac-proxy/0.log" Jul 08 19:45:43.542057 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.542030 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9xfr_e98bd1f1-7515-419e-8625-ea1499f4195b/init-textfile/0.log" Jul 08 19:45:43.646222 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.646144 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j5lk6_4d2a5366-28df-4ebf-95b1-09ae454185b5/kube-rbac-proxy-main/0.log" Jul 08 19:45:43.670540 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.670508 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j5lk6_4d2a5366-28df-4ebf-95b1-09ae454185b5/kube-rbac-proxy-self/0.log" Jul 08 19:45:43.694422 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.694394 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-j5lk6_4d2a5366-28df-4ebf-95b1-09ae454185b5/openshift-state-metrics/0.log" Jul 08 19:45:43.993199 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:43.993173 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65cc96494-8h9nc_9e7eb729-1eaf-48f0-8099-8a85f81049b9/telemeter-client/0.log" Jul 08 19:45:44.016310 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:44.016282 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65cc96494-8h9nc_9e7eb729-1eaf-48f0-8099-8a85f81049b9/reload/0.log" Jul 08 19:45:44.040422 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:44.040398 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65cc96494-8h9nc_9e7eb729-1eaf-48f0-8099-8a85f81049b9/kube-rbac-proxy/0.log" Jul 08 19:45:44.069564 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:44.069520 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657666f54d-8wqvb_5b85877b-3481-48b7-a104-9ca6373c3683/thanos-query/0.log" Jul 08 19:45:44.091356 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:44.091323 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657666f54d-8wqvb_5b85877b-3481-48b7-a104-9ca6373c3683/kube-rbac-proxy-web/0.log" Jul 08 19:45:44.114669 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:44.114637 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657666f54d-8wqvb_5b85877b-3481-48b7-a104-9ca6373c3683/kube-rbac-proxy/0.log" Jul 08 19:45:44.137291 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:44.137265 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657666f54d-8wqvb_5b85877b-3481-48b7-a104-9ca6373c3683/prom-label-proxy/0.log" Jul 08 19:45:44.164309 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:44.164281 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657666f54d-8wqvb_5b85877b-3481-48b7-a104-9ca6373c3683/kube-rbac-proxy-rules/0.log" Jul 08 19:45:44.187113 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:44.187076 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-657666f54d-8wqvb_5b85877b-3481-48b7-a104-9ca6373c3683/kube-rbac-proxy-metrics/0.log" Jul 08 19:45:45.743653 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.743616 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822"] Jul 08 19:45:45.744279 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.744258 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83bc6f06-bb7d-4870-b5a1-800dcc3b642c" containerName="maas-api" Jul 08 19:45:45.744377 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.744281 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="83bc6f06-bb7d-4870-b5a1-800dcc3b642c" containerName="maas-api" Jul 08 19:45:45.744466 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.744413 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="83bc6f06-bb7d-4870-b5a1-800dcc3b642c" containerName="maas-api" Jul 08 19:45:45.747916 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.747886 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.749869 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.749845 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlh8b\"/\"openshift-service-ca.crt\"" Jul 08 19:45:45.749979 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.749881 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlh8b\"/\"kube-root-ca.crt\"" Jul 08 19:45:45.750182 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.750168 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hlh8b\"/\"default-dockercfg-b6282\"" Jul 08 19:45:45.753944 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.753921 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822"] Jul 08 19:45:45.872022 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.871984 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9cls\" (UniqueName: \"kubernetes.io/projected/e4f95c38-2df3-4504-8d70-f9f67fcb3686-kube-api-access-f9cls\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.872205 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.872028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-sys\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.872205 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.872055 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-lib-modules\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.872205 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.872108 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-podres\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.872205 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.872158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-proc\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973557 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9cls\" (UniqueName: \"kubernetes.io/projected/e4f95c38-2df3-4504-8d70-f9f67fcb3686-kube-api-access-f9cls\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973557 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973556 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-sys\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973580 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-lib-modules\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-podres\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973621 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-proc\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973676 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-sys\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973699 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-proc\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973730 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-lib-modules\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.973829 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.973742 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4f95c38-2df3-4504-8d70-f9f67fcb3686-podres\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:45.981518 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:45.981486 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9cls\" (UniqueName: \"kubernetes.io/projected/e4f95c38-2df3-4504-8d70-f9f67fcb3686-kube-api-access-f9cls\") pod \"perf-node-gather-daemonset-jt822\" (UID: \"e4f95c38-2df3-4504-8d70-f9f67fcb3686\") " pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:46.060296 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:46.060201 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:46.201130 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:46.201106 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822"] Jul 08 19:45:46.203472 ip-10-0-129-210 kubenswrapper[2560]: W0708 19:45:46.203435 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode4f95c38_2df3_4504_8d70_f9f67fcb3686.slice/crio-5e3bbd08ac86dd3a52945b0fa6f5ccae113efd6f3310161f68b5d328e802ed46 WatchSource:0}: Error finding container 5e3bbd08ac86dd3a52945b0fa6f5ccae113efd6f3310161f68b5d328e802ed46: Status 404 returned error can't find the container with id 5e3bbd08ac86dd3a52945b0fa6f5ccae113efd6f3310161f68b5d328e802ed46 Jul 08 19:45:46.340610 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:46.340568 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" event={"ID":"e4f95c38-2df3-4504-8d70-f9f67fcb3686","Type":"ContainerStarted","Data":"446b4530e03079fb67f5ad8f64433a6371851b86923f8af16282c3b3a20e2f5c"} Jul 08 19:45:46.340763 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:46.340622 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" event={"ID":"e4f95c38-2df3-4504-8d70-f9f67fcb3686","Type":"ContainerStarted","Data":"5e3bbd08ac86dd3a52945b0fa6f5ccae113efd6f3310161f68b5d328e802ed46"} Jul 08 19:45:46.340763 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:46.340714 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:46.357774 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:46.357718 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" podStartSLOduration=1.357687805 podStartE2EDuration="1.357687805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:45:46.354787189 +0000 UTC m=+2645.045778710" watchObservedRunningTime="2026-07-08 19:45:46.357687805 +0000 UTC m=+2645.048679328" Jul 08 19:45:46.583003 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:46.582922 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86c495ccdd-wgdf8_b69a621c-e367-42b9-aef9-244e3e528b18/console/0.log" Jul 08 19:45:48.305876 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:48.305844 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sjvht_77cee5da-d849-4446-9a64-4608cb395353/dns/0.log" Jul 08 19:45:48.328753 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:48.328720 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sjvht_77cee5da-d849-4446-9a64-4608cb395353/kube-rbac-proxy/0.log" Jul 08 19:45:48.453320 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:48.453290 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vxj69_08e8e9f1-6b00-4fba-af7b-7f20f63ebad8/dns-node-resolver/0.log" Jul 08 19:45:49.020160 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:49.020128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4fmgw_d62a6106-3277-43a7-b7c8-d4584ff83871/node-ca/0.log" Jul 08 19:45:50.168296 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:50.168254 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-85nc8_369a4f7c-112c-448f-ba73-f7a26b81a3f3/discovery/0.log" Jul 08 19:45:50.396112 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:50.396084 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-b2d5b_b0a8c4ce-b6f8-4086-b1d3-11528367630c/payload-processing/0.log" Jul 08 19:45:51.122348 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:51.122309 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cgb25_7af9a6bc-b84e-46e6-8a0c-414913508676/serve-healthcheck-canary/0.log" Jul 08 19:45:51.666443 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:51.666406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6nzw_896ba504-79d4-4baf-8537-dde513642ece/kube-rbac-proxy/0.log" Jul 08 19:45:51.688741 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:51.688711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6nzw_896ba504-79d4-4baf-8537-dde513642ece/exporter/0.log" Jul 08 19:45:51.712796 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:51.712760 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h6nzw_896ba504-79d4-4baf-8537-dde513642ece/extractor/0.log" Jul 08 19:45:52.356663 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:52.356636 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hlh8b/perf-node-gather-daemonset-jt822" Jul 08 19:45:54.219515 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:54.219482 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d775d5cc6-ljwjc_1e7f52f0-05a1-4d38-a120-1ffd3bc8d6e5/manager/0.log" Jul 08 19:45:54.392082 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:54.392053 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-l9q96_2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09/manager/0.log" Jul 08 19:45:54.415632 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:54.415604 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9dc45487-l9q96_2b5e7d1a-91ed-4cf5-b500-6e53a78b9d09/copy-manifests/0.log" Jul 08 19:45:55.995046 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:55.995020 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-ff8fc7d87-md9sw_d59111b1-53fb-416c-b353-6ac955026418/manager/0.log" Jul 08 19:45:56.032358 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:56.032271 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-2vvlw_965eb4fe-6e45-40b7-b04e-e4d23ca48bed/openshift-lws-operator/0.log" Jul 08 19:45:56.639646 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:56.639617 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-85nc8_369a4f7c-112c-448f-ba73-f7a26b81a3f3/discovery/0.log" Jul 08 19:45:56.806501 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:56.806468 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-b2d5b_b0a8c4ce-b6f8-4086-b1d3-11528367630c/payload-processing/0.log" Jul 08 19:45:58.135441 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:58.135405 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-85nc8_369a4f7c-112c-448f-ba73-f7a26b81a3f3/discovery/0.log" Jul 08 19:45:58.315831 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:45:58.315797 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-b2d5b_b0a8c4ce-b6f8-4086-b1d3-11528367630c/payload-processing/0.log" Jul 08 19:46:02.559344 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:02.559303 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4ffqm_6c13a6c5-5b12-4118-9122-74c8b9ecd5b9/kube-multus/0.log" Jul 08 19:46:02.956304 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:02.956218 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm2ds_8d1ed88f-1103-4016-8544-4729840f472d/kube-multus-additional-cni-plugins/0.log" Jul 08 19:46:02.980722 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:02.980657 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm2ds_8d1ed88f-1103-4016-8544-4729840f472d/egress-router-binary-copy/0.log" Jul 08 19:46:03.002351 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:03.002319 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm2ds_8d1ed88f-1103-4016-8544-4729840f472d/cni-plugins/0.log" Jul 08 19:46:03.024215 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:03.024184 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm2ds_8d1ed88f-1103-4016-8544-4729840f472d/bond-cni-plugin/0.log" Jul 08 19:46:03.045920 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:03.045886 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm2ds_8d1ed88f-1103-4016-8544-4729840f472d/routeoverride-cni/0.log" Jul 08 19:46:03.067151 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:03.067124 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm2ds_8d1ed88f-1103-4016-8544-4729840f472d/whereabouts-cni-bincopy/0.log" Jul 08 19:46:03.089294 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:03.089264 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xm2ds_8d1ed88f-1103-4016-8544-4729840f472d/whereabouts-cni/0.log" Jul 08 19:46:03.188964 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:03.188930 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vk797_eb492e2e-7cb5-43e7-b25e-4507b7fa2d28/network-metrics-daemon/0.log" Jul 08 19:46:03.212595 ip-10-0-129-210 kubenswrapper[2560]: I0708 19:46:03.212478 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vk797_eb492e2e-7cb5-43e7-b25e-4507b7fa2d28/kube-rbac-proxy/0.log"