Jul 15 22:14:15.845767 ip-10-0-136-87 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 22:14:15.845776 ip-10-0-136-87 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 22:14:15.845783 ip-10-0-136-87 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 22:14:15.845993 ip-10-0-136-87 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 22:14:26.017672 ip-10-0-136-87 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 22:14:26.017687 ip-10-0-136-87 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dc41afad18c5448bb954b44d265d3033 -- Jul 15 22:16:24.711570 ip-10-0-136-87 systemd[1]: Starting Kubernetes Kubelet... Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.098007 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107764 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107782 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107787 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107791 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107796 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107802 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107809 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:16:25.288099 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107814 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:16:25.170535 ip-10-0-136-87 systemd[1]: Started Kubernetes Kubelet. Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107819 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107824 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107828 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107833 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107838 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107843 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107847 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107852 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107856 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107860 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107864 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107868 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107873 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107877 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107883 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107888 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107893 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107898 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:16:25.297679 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107903 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107907 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107910 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107913 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107916 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107919 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107923 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107926 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107929 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107933 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107936 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107939 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107941 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107944 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107947 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107949 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107952 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107955 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107958 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:16:25.298419 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107960 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107963 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107966 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107969 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107972 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107975 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107977 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107982 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107984 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107987 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107989 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107992 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107994 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107997 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.107999 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108002 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108005 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108007 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108010 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108013 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:16:25.299053 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108016 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108018 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108021 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108024 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108026 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108029 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108031 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108034 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108037 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108039 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108042 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108045 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108049 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108052 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108055 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108058 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108061 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108064 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108068 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108071 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:16:25.299675 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108074 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108076 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108079 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108082 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108084 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108087 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108089 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108091 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108094 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108096 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108099 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108102 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108104 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108107 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108905 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108914 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108917 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108920 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108923 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:16:25.300265 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108926 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108931 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108935 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108938 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108941 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108944 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108946 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108949 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108951 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108954 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108957 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108960 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108963 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108966 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108968 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108971 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108973 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108976 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108978 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:16:25.301009 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108981 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108983 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108985 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108988 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108990 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108993 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108996 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.108998 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109002 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109007 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109011 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109014 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109017 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109020 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109022 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109025 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109028 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109030 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109032 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:16:25.301820 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109035 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109037 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109040 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109043 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109045 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109048 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109050 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109054 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109057 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109060 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109063 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109065 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109068 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109071 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109075 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109079 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109082 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109084 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109088 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109091 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:16:25.302399 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109094 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109096 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109100 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109102 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109105 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109108 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109110 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109113 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109115 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109118 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109120 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109123 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109126 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109129 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109131 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109134 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109136 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109139 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109141 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109144 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:16:25.303192 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109147 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109150 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109152 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109155 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109157 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109160 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109162 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109165 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109167 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109170 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109172 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109174 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109177 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109179 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109182 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109185 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109577 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109585 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109589 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:16:25.303790 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109593 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109596 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109599 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109602 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109604 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109607 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109610 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109612 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109615 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109618 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109620 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109623 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109625 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109628 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109631 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109634 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109636 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109639 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109641 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109644 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:16:25.304392 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109647 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109649 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109652 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109654 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109657 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109660 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109662 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109664 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109667 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109670 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109672 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109675 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109678 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109680 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109683 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109686 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109689 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109691 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109694 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109696 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:16:25.304964 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109699 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109702 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109706 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109709 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109712 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109714 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109717 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109721 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109723 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109725 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109728 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109731 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109733 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109736 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109738 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109740 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109743 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109745 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109748 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:16:25.305586 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109750 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109752 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109755 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109757 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109761 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109763 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109766 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109769 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109771 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109774 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109776 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109779 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109782 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109784 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109786 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109789 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109791 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109794 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109796 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109799 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:16:25.306070 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109802 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109805 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109807 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109810 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109813 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109815 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109818 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109821 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109827 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109831 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109835 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109838 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109840 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109843 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109846 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109849 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.109852 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109922 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109933 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109942 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 22:16:25.306637 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109948 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109954 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109958 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109964 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109968 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109971 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109974 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109978 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109981 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109984 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109987 2564 flags.go:64] FLAG: --cgroup-root="" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109990 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109993 2564 flags.go:64] FLAG: --client-ca-file="" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.109997 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110000 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110004 2564 flags.go:64] FLAG: --cluster-domain="" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110006 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110010 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110013 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110016 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110022 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110025 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110028 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 22:16:25.307146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110031 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110034 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110037 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110040 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110043 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110046 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110050 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110053 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110056 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110059 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110075 2564 flags.go:64] FLAG: --enable-server="true" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110079 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110084 2564 flags.go:64] FLAG: --event-burst="100" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110087 2564 flags.go:64] FLAG: --event-qps="50" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110090 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110093 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110101 2564 flags.go:64] FLAG: --eviction-hard="" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110105 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110108 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110111 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110114 2564 flags.go:64] FLAG: --eviction-soft="" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110117 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110120 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110123 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110126 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 22:16:25.307783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110129 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110132 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110135 2564 flags.go:64] FLAG: --feature-gates="" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110138 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110142 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110145 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110148 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110151 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110154 2564 flags.go:64] FLAG: --help="false" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110157 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110160 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110163 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110166 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110169 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110172 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110175 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110178 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110181 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110184 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110186 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110189 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110192 2564 flags.go:64] FLAG: --kube-reserved="" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110195 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110199 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 22:16:25.308490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110202 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110205 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110208 2564 flags.go:64] FLAG: --lock-file="" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110211 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110213 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110216 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110222 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110225 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110228 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110231 2564 flags.go:64] FLAG: --logging-format="text" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110234 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110237 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110241 2564 flags.go:64] FLAG: --manifest-url="" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110244 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110248 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110251 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110255 2564 flags.go:64] FLAG: --max-pods="110" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110258 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110261 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110264 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110267 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110269 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110272 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110275 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110297 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 22:16:25.309154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110300 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110303 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110306 2564 flags.go:64] FLAG: --pod-cidr="" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110309 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110313 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110316 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110321 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110324 2564 flags.go:64] FLAG: --port="10250" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110326 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110329 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e83ddb282724edc8" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110333 2564 flags.go:64] FLAG: --qos-reserved="" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110335 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110338 2564 flags.go:64] FLAG: --register-node="true" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110341 2564 flags.go:64] FLAG: --register-with-taints="" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110345 2564 flags.go:64] FLAG: --registry-burst="10" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110348 2564 flags.go:64] FLAG: --registry-qps="5" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110351 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110354 2564 flags.go:64] FLAG: --reserved-memory="" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110357 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110360 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110364 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110367 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110370 2564 flags.go:64] FLAG: --runonce="false" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110373 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110376 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 22:16:25.585212 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110379 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110382 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110385 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110387 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110390 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110393 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110396 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110399 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110402 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110405 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110408 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110411 2564 flags.go:64] FLAG: --system-cgroups="" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110413 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110420 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110423 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110425 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110429 2564 flags.go:64] FLAG: --tls-min-version="" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110432 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110435 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110438 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110441 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110443 2564 flags.go:64] FLAG: --v="2" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110447 2564 flags.go:64] FLAG: --version="false" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110451 2564 flags.go:64] FLAG: --vmodule="" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110455 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 22:16:25.586755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.110458 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110584 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110591 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110594 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110597 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110600 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110603 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110606 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110609 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110612 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110614 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110617 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110620 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110622 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110625 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110627 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110630 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110632 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110635 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:16:25.588389 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110639 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110644 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110647 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110650 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110653 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110656 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110658 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110661 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110663 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110666 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110668 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110671 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110674 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110677 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110679 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110684 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110688 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110691 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110693 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:16:25.589017 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110696 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110699 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110701 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110704 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110706 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110709 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110712 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110714 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110717 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110719 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110722 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110724 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110727 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110729 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110733 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110736 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110739 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110741 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110744 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110747 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110749 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:16:25.589599 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110752 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110755 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110758 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110760 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110763 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110766 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110769 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110773 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110776 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110779 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110781 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110784 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110787 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110789 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110792 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110794 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110797 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110800 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110802 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110805 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:16:25.590225 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110808 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110810 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110813 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110816 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110818 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110821 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110824 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110827 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110830 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110834 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110837 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110840 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110843 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110846 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110849 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110851 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110854 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110857 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110859 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:16:25.590814 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110863 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.110866 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.111328 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.118706 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.118723 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.118739 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.118744 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118804 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118809 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118813 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118816 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118819 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118821 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118824 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:16:25.591394 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118827 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118831 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118835 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118838 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118841 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118844 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118847 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118850 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118853 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118856 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118859 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118862 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118866 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118871 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118874 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118877 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118880 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118883 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118885 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:16:25.591850 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118888 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118891 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118894 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118897 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118900 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118903 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118905 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118908 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118911 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118913 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118916 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118918 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118921 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118923 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118926 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118928 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118931 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118935 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118938 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118940 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:16:25.592448 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118943 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118945 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118948 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118951 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118953 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118956 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118960 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118962 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118965 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118968 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118970 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118973 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118976 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118978 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118981 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118984 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118988 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118992 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118995 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:16:25.840610 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.118998 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119000 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119003 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119006 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119008 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119011 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119014 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119016 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119019 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119021 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119025 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119028 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119030 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119033 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119035 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119038 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119041 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119043 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119046 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119050 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:16:25.841863 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119053 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119056 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119058 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119061 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119064 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119066 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119069 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119071 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119074 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119077 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119080 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119083 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119085 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119088 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.119093 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:16:25.842550 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119200 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119204 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119206 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119209 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119212 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119214 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119217 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119219 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119223 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119226 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119228 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119231 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119234 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119237 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119239 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119242 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119246 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119248 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119251 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119253 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 22:16:25.843234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119256 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119258 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119261 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119263 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119266 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119268 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119271 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119273 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119276 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119279 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119299 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119303 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119306 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119308 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119311 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119314 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119316 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119319 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119321 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 22:16:25.843931 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119324 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119327 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119330 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119333 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119336 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119338 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119341 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119344 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119348 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119352 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119354 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119357 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119360 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119362 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119365 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119368 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119370 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119373 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119376 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119378 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 22:16:25.844627 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119381 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119384 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119390 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119393 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119396 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119398 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119401 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119404 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119408 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119411 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119414 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119417 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119420 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119424 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119426 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119429 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119432 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119435 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119438 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119440 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 22:16:25.845325 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119443 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119447 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119450 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119453 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119455 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119458 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119461 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119463 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119467 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119470 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119473 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119476 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119479 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119481 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119484 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119488 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119490 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119493 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119495 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 22:16:25.846010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:25.119497 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.119502 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.119605 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.121439 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.122723 2564 server.go:1019] "Starting client certificate rotation" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.123867 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.124456 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.125123 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.129580 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.141442 2564 log.go:25] "Validated CRI v1 runtime API" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.143511 2564 log.go:25] "Validated CRI v1 image API" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.144248 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 22:16:25.846669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.146739 2564 fs.go:135] Filesystem UUIDs: map[394de84c-d3ff-4cb2-a7bb-ae008d521ae5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d6fc830e-5e93-462a-b5a4-0d734de98fdd:/dev/nvme0n1p3] Jul 15 22:16:25.847096 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.146754 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 22:16:25.847328 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.152348 2564 manager.go:216] Machine: {Timestamp:2026-07-15 22:16:25.151206877 +0000 UTC m=+0.321864306 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100433 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bc927d9820421d0ee0b51c4bdb75a SystemUUID:ec2bc927-d982-0421-d0ee-0b51c4bdb75a BootID:dc41afad-18c5-448b-b954-b44d265d3033 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:17:df:52:b7:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:17:df:52:b7:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:b8:29:00:fb:eb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 22:16:25.847328 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.152448 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 22:16:25.847328 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.152534 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 22:16:25.847328 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.153690 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 22:16:25.847328 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.155180 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 22:16:25.847328 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.155204 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 22:16:25.847328 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.155929 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.155938 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.155946 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.156674 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.157788 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.160621 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.160731 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.160757 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.160765 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.160774 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.160783 2564 kubelet.go:398] "Adding apiserver pod source" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.160791 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.161068 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.161094 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.163118 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165015 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165042 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165179 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165192 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165198 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165203 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165212 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165217 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165667 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165673 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165679 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165685 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165709 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.165717 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.166561 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.166568 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.169532 2564 server.go:1268] "Started kubelet" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.169845 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.169901 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.169911 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.169972 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.170046 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.170076 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.171253 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.173088 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 15 22:16:25.847790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.176547 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.176564 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.176681 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177037 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177045 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177096 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177126 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fg4vt" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177231 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177240 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.174493 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-87.ec2.internal.18c2966a2db28dcc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-87.ec2.internal,UID:ip-10-0-136-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-87.ec2.internal,},FirstTimestamp:2026-07-15 22:16:25.169513932 +0000 UTC m=+0.340171359,LastTimestamp:2026-07-15 22:16:25.169513932 +0000 UTC m=+0.340171359,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-87.ec2.internal,}" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.177849 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177919 2564 factory.go:153] Registering CRI-O factory Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177930 2564 factory.go:223] Registration of the crio container factory successfully Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177976 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177985 2564 factory.go:55] Registering systemd factory Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.177991 2564 factory.go:223] Registration of the systemd container factory successfully Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.178010 2564 factory.go:103] Registering Raw factory Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.178019 2564 manager.go:1196] Started watching for new ooms in manager Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.178331 2564 manager.go:349] Starting recovery of all containers Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.183817 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fg4vt" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.185412 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.185637 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.187566 2564 manager.go:354] Recovery completed Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.191902 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.193573 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.193597 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.193606 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.194083 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.194094 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.194098 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.194110 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.194691 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:16:25.851093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.194732 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.194749 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.195089 2564 policy_none.go:49] "None policy: Start" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.195102 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.195111 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.196073 2564 policy_none.go:47] "Start" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.229811 2564 manager.go:337] "Starting Device Plugin manager" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.229835 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.229843 2564 server.go:87] "Starting device plugin registration server" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.230025 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.230036 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.230183 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.231159 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.231173 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.231526 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.231602 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.330615 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.331491 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.331513 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.331525 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.331553 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.339563 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.339579 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-87.ec2.internal\": node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.353412 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.364104 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.365199 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.365227 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.365245 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.365271 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.367766 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.453741 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.465715 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal"] Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.465785 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.470265 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.470310 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.470323 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.471581 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.471688 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.852287 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.471714 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.472292 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.472358 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.472371 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.472317 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.472428 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.472438 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.473729 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.473754 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.475118 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientMemory" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.475142 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.475152 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeHasSufficientPID" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.478476 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/975caee66701c49e86b719a0cf012f15-config\") pod \"kube-apiserver-proxy-ip-10-0-136-87.ec2.internal\" (UID: \"975caee66701c49e86b719a0cf012f15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.478509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2715b6aef39cde3c38b00cf62da2e9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"d2715b6aef39cde3c38b00cf62da2e9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.478536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2715b6aef39cde3c38b00cf62da2e9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"d2715b6aef39cde3c38b00cf62da2e9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.504030 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-87.ec2.internal\" not found" node="ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.508478 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-87.ec2.internal\" not found" node="ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.554244 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.579321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2715b6aef39cde3c38b00cf62da2e9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"d2715b6aef39cde3c38b00cf62da2e9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.579371 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/975caee66701c49e86b719a0cf012f15-config\") pod \"kube-apiserver-proxy-ip-10-0-136-87.ec2.internal\" (UID: \"975caee66701c49e86b719a0cf012f15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.579406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/975caee66701c49e86b719a0cf012f15-config\") pod \"kube-apiserver-proxy-ip-10-0-136-87.ec2.internal\" (UID: \"975caee66701c49e86b719a0cf012f15\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 15 22:16:25.859117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.579432 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2715b6aef39cde3c38b00cf62da2e9d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"d2715b6aef39cde3c38b00cf62da2e9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.579443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2715b6aef39cde3c38b00cf62da2e9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"d2715b6aef39cde3c38b00cf62da2e9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.579473 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d2715b6aef39cde3c38b00cf62da2e9d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal\" (UID: \"d2715b6aef39cde3c38b00cf62da2e9d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.656262 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.761934 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.807696 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:25.811812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.862379 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:25.963381 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.076871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:26.066704 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.347924 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.124733 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 22:16:26.347924 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.124861 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 22:16:26.347924 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:26.167626 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.347924 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.191374 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 22:11:25 +0000 UTC" deadline="2028-01-01 05:17:02.535532008 +0000 UTC" Jul 15 22:16:26.347924 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.191394 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12823h0m36.344140875s" Jul 15 22:16:26.347924 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.260212 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:16:26.347924 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:26.268687 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.482682 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:26.369811 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.482682 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:26.470494 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.583306 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.511670 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:16:26.583306 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:26.570967 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.684255 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:26.671633 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-87.ec2.internal\" not found" Jul 15 22:16:26.686095 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.685491 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:16:26.788529 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.777738 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" Jul 15 22:16:26.788529 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.787090 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 22:16:26.788529 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.788191 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" Jul 15 22:16:26.794846 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:26.793360 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975caee66701c49e86b719a0cf012f15.slice/crio-5627ebb981289fe20f8eb407c16aedc3375ed3f0d45f4ebbb4b59206afa0ece7 WatchSource:0}: Error finding container 5627ebb981289fe20f8eb407c16aedc3375ed3f0d45f4ebbb4b59206afa0ece7: Status 404 returned error can't find the container with id 5627ebb981289fe20f8eb407c16aedc3375ed3f0d45f4ebbb4b59206afa0ece7 Jul 15 22:16:26.799674 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.798707 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:16:26.799674 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:26.799245 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 22:16:26.899033 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:26.852214 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2715b6aef39cde3c38b00cf62da2e9d.slice/crio-c9ee627831890d03332985649d0353a17818b9b5f4e6f618d24025f11c4c28a7 WatchSource:0}: Error finding container c9ee627831890d03332985649d0353a17818b9b5f4e6f618d24025f11c4c28a7: Status 404 returned error can't find the container with id c9ee627831890d03332985649d0353a17818b9b5f4e6f618d24025f11c4c28a7 Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.161912 2564 apiserver.go:52] "Watching apiserver" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.169657 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.170763 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2","openshift-cluster-node-tuning-operator/tuned-7c662","openshift-dns/node-resolver-4tf58","openshift-multus/multus-additional-cni-plugins-pvdhq","openshift-network-operator/iptables-alerter-xhk4j","openshift-image-registry/node-ca-m2mrj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal","openshift-multus/multus-gz5dt","openshift-multus/network-metrics-daemon-7rh6n","openshift-network-diagnostics/network-check-target-jrzdp","openshift-ovn-kubernetes/ovnkube-node-tmhl7","kube-system/global-pull-secret-syncer-hp4bm","kube-system/konnectivity-agent-9t8qj","kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal"] Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.172337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.172429 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.173441 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.174985 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.176418 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.176782 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4rkv5\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.176873 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.176936 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.177388 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.177473 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.177718 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.178977 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qbh58\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.179172 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.179749 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.179793 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.180071 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.180086 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.180185 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.180212 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-94vtx\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.180477 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.181419 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.181528 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.181649 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7fs2r\"" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.181747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:27.250717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.181774 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.181806 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.182553 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.182609 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.182768 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.182796 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qdlvw\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.183341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.184792 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.185476 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-95zp2\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.185509 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.186106 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.186983 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.187075 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.187200 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-grdd6\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.187738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188230 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188467 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188491 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188551 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h4vlc\"" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppkqf\" (UniqueName: \"kubernetes.io/projected/91881515-819d-4d72-af89-5a346c2df818-kube-api-access-ppkqf\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-system-cni-dir\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.258940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91881515-819d-4d72-af89-5a346c2df818-hosts-file\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cnibin\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188731 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-os-release\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xh4j\" (UniqueName: \"kubernetes.io/projected/c780bef1-c7eb-422f-a162-bd84f5ef20ca-kube-api-access-9xh4j\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188776 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/225cb751-612d-4b5f-b46c-18468dd0b23c-agent-certs\") pod \"konnectivity-agent-9t8qj\" (UID: \"225cb751-612d-4b5f-b46c-18468dd0b23c\") " pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/225cb751-612d-4b5f-b46c-18468dd0b23c-konnectivity-ca\") pod \"konnectivity-agent-9t8qj\" (UID: \"225cb751-612d-4b5f-b46c-18468dd0b23c\") " pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188817 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91881515-819d-4d72-af89-5a346c2df818-tmp-dir\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.188843 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.189385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.189446 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.189808 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rhsbb\"" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.189954 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.190181 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.191361 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.191382 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.191382 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 22:16:27.260047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.191485 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 22:16:27.260810 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.191544 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 22:16:27.260810 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.210989 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bs2nc" Jul 15 22:16:27.260810 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.221584 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bs2nc" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.278810 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289002 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-os-release\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289043 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-systemd\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovnkube-config\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dk8x\" (UniqueName: \"kubernetes.io/projected/8c16e95e-e3a3-43be-853a-6e5277355c2c-kube-api-access-6dk8x\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/225cb751-612d-4b5f-b46c-18468dd0b23c-agent-certs\") pod \"konnectivity-agent-9t8qj\" (UID: \"225cb751-612d-4b5f-b46c-18468dd0b23c\") " pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289139 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-host-slash\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysctl-conf\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-run\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289350 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db944276-6d28-4640-bf44-d92bdaf38335-etc-tuned\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.351888 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppkqf\" (UniqueName: \"kubernetes.io/projected/91881515-819d-4d72-af89-5a346c2df818-kube-api-access-ppkqf\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-device-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-socket-dir-parent\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-multus-certs\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289478 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-host\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cnibin\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289522 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-os-release\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvt8h\" (UniqueName: \"kubernetes.io/projected/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-kube-api-access-tvt8h\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289571 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysctl-d\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-sys\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289642 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-ovn\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.353355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cnibin\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-os-release\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289706 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovn-node-metrics-cert\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xh4j\" (UniqueName: \"kubernetes.io/projected/c780bef1-c7eb-422f-a162-bd84f5ef20ca-kube-api-access-9xh4j\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289765 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62f11e48-e712-4fdc-89ab-22758881823d-dbus\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-cni-multus\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-kubelet\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-conf-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysconfig\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/225cb751-612d-4b5f-b46c-18468dd0b23c-konnectivity-ca\") pod \"konnectivity-agent-9t8qj\" (UID: \"225cb751-612d-4b5f-b46c-18468dd0b23c\") " pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.289969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-system-cni-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.354104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290004 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-var-lib-kubelet\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-run-netns\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-systemd\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-var-lib-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290134 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovnkube-script-lib\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-hostroot\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290183 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-modprobe-d\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-kubernetes\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290260 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6frdn\" (UniqueName: \"kubernetes.io/projected/a7cdc335-ff35-425f-8920-3653c3148dd0-kube-api-access-6frdn\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-netns\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-cni-bin\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290337 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/225cb751-612d-4b5f-b46c-18468dd0b23c-konnectivity-ca\") pod \"konnectivity-agent-9t8qj\" (UID: \"225cb751-612d-4b5f-b46c-18468dd0b23c\") " pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-log-socket\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.355194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2kr8\" (UniqueName: \"kubernetes.io/projected/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-kube-api-access-j2kr8\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-daemon-config\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7cdc335-ff35-425f-8920-3653c3148dd0-host\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290434 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-cnibin\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-kubelet\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91881515-819d-4d72-af89-5a346c2df818-tmp-dir\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7cdc335-ff35-425f-8920-3653c3148dd0-serviceca\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-cni-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-lib-modules\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290574 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqrr7\" (UniqueName: \"kubernetes.io/projected/087a2888-741d-49e1-88e2-2ad9b12e3a02-kube-api-access-jqrr7\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db944276-6d28-4640-bf44-d92bdaf38335-tmp\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-slash\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290661 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-iptables-alerter-script\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/087a2888-741d-49e1-88e2-2ad9b12e3a02-cni-binary-copy\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290747 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-cni-netd\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-env-overrides\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91881515-819d-4d72-af89-5a346c2df818-tmp-dir\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290819 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-systemd-units\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62f11e48-e712-4fdc-89ab-22758881823d-kubelet-config\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqlz\" (UniqueName: \"kubernetes.io/projected/4469b73c-e23d-408d-be6b-656c08681932-kube-api-access-lmqlz\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290905 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-cni-bin\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-etc-kubernetes\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-system-cni-dir\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.357475 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290996 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c780bef1-c7eb-422f-a162-bd84f5ef20ca-system-cni-dir\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.290996 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.291023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-k8s-cni-cncf-io\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.291052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-node-log\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.291077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91881515-819d-4d72-af89-5a346c2df818-hosts-file\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.291103 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.291133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8msl\" (UniqueName: \"kubernetes.io/projected/db944276-6d28-4640-bf44-d92bdaf38335-kube-api-access-t8msl\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.291148 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/91881515-819d-4d72-af89-5a346c2df818-hosts-file\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.291162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-etc-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.292178 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.292275 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.292318 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c780bef1-c7eb-422f-a162-bd84f5ef20ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.292985 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/225cb751-612d-4b5f-b46c-18468dd0b23c-agent-certs\") pod \"konnectivity-agent-9t8qj\" (UID: \"225cb751-612d-4b5f-b46c-18468dd0b23c\") " pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.296525 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.296547 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:16:27.357882 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.296563 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2b542 for pod openshift-network-diagnostics/network-check-target-jrzdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:27.358278 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.296626 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542 podName:64ee5b66-5658-44f6-af78-803a3f987af6 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.79660636 +0000 UTC m=+2.967263777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2b542" (UniqueName: "kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542") pod "network-check-target-jrzdp" (UID: "64ee5b66-5658-44f6-af78-803a3f987af6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:27.358278 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.297426 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppkqf\" (UniqueName: \"kubernetes.io/projected/91881515-819d-4d72-af89-5a346c2df818-kube-api-access-ppkqf\") pod \"node-resolver-4tf58\" (UID: \"91881515-819d-4d72-af89-5a346c2df818\") " pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.358278 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.298091 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xh4j\" (UniqueName: \"kubernetes.io/projected/c780bef1-c7eb-422f-a162-bd84f5ef20ca-kube-api-access-9xh4j\") pod \"multus-additional-cni-plugins-pvdhq\" (UID: \"c780bef1-c7eb-422f-a162-bd84f5ef20ca\") " pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.369744 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.369698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" event={"ID":"d2715b6aef39cde3c38b00cf62da2e9d","Type":"ContainerStarted","Data":"c9ee627831890d03332985649d0353a17818b9b5f4e6f618d24025f11c4c28a7"} Jul 15 22:16:27.370740 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.370718 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" event={"ID":"975caee66701c49e86b719a0cf012f15","Type":"ContainerStarted","Data":"5627ebb981289fe20f8eb407c16aedc3375ed3f0d45f4ebbb4b59206afa0ece7"} Jul 15 22:16:27.388319 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.388296 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 22:16:27.389409 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.389391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:27.391859 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.391833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-host-slash\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.391953 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.391871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.391953 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.391898 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysctl-conf\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.391953 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.391920 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-run\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.391953 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.391944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db944276-6d28-4640-bf44-d92bdaf38335-etc-tuned\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.391968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-device-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.391992 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-socket-dir-parent\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392018 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-multus-certs\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-host\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvt8h\" (UniqueName: \"kubernetes.io/projected/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-kube-api-access-tvt8h\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysctl-d\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-sys\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-ovn\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.392183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovn-node-metrics-cert\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62f11e48-e712-4fdc-89ab-22758881823d-dbus\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-cni-multus\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-kubelet\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-conf-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysconfig\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392400 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-ovn\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392411 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-multus-certs\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392475 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-host\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392523 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-socket-dir-parent\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392536 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysctl-d\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.393054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392563 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-cni-multus\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392565 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-device-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392579 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-host-slash\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392603 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-kubelet\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392620 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-sys\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392627 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392657 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-conf-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392721 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysconfig\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392748 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-system-cni-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392752 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62f11e48-e712-4fdc-89ab-22758881823d-dbus\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392778 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-var-lib-kubelet\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392802 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-run-netns\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392805 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-system-cni-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392822 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-systemd\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.393773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392845 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-var-lib-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-sysctl-conf\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392845 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-var-lib-kubelet\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392849 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-run-netns\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovnkube-script-lib\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392898 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-run\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392939 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-var-lib-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.392955 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-hostroot\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393016 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-systemd\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-modprobe-d\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-kubernetes\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393133 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-hostroot\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6frdn\" (UniqueName: \"kubernetes.io/projected/a7cdc335-ff35-425f-8920-3653c3148dd0-kube-api-access-6frdn\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-kubernetes\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-netns\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.394500 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393306 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-modprobe-d\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-cni-bin\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-log-socket\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393548 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2kr8\" (UniqueName: \"kubernetes.io/projected/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-kube-api-access-j2kr8\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-daemon-config\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-socket-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393661 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-netns\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7cdc335-ff35-425f-8920-3653c3148dd0-host\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-cnibin\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovnkube-script-lib\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-kubelet\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393780 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-kubelet\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-cnibin\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393662 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7cdc335-ff35-425f-8920-3653c3148dd0-host\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.395232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7cdc335-ff35-425f-8920-3653c3148dd0-serviceca\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.393996 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-cni-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394034 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-lib-modules\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqrr7\" (UniqueName: \"kubernetes.io/projected/087a2888-741d-49e1-88e2-2ad9b12e3a02-kube-api-access-jqrr7\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394080 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db944276-6d28-4640-bf44-d92bdaf38335-tmp\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-slash\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-iptables-alerter-script\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/087a2888-741d-49e1-88e2-2ad9b12e3a02-cni-binary-copy\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-cni-netd\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-env-overrides\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-systemd-units\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62f11e48-e712-4fdc-89ab-22758881823d-kubelet-config\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.395961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394459 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqlz\" (UniqueName: \"kubernetes.io/projected/4469b73c-e23d-408d-be6b-656c08681932-kube-api-access-lmqlz\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394485 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-cni-bin\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.394496 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-etc-kubernetes\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-k8s-cni-cncf-io\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.394568 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret podName:62f11e48-e712-4fdc-89ab-22758881823d nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.894550622 +0000 UTC m=+3.065208057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret") pod "global-pull-secret-syncer-hp4bm" (UID: "62f11e48-e712-4fdc-89ab-22758881823d") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394584 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-run-k8s-cni-cncf-io\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-node-log\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394622 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-systemd-units\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.394625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.394676 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8msl\" (UniqueName: \"kubernetes.io/projected/db944276-6d28-4640-bf44-d92bdaf38335-kube-api-access-t8msl\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-etc-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-os-release\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.396717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-systemd\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovnkube-config\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dk8x\" (UniqueName: \"kubernetes.io/projected/8c16e95e-e3a3-43be-853a-6e5277355c2c-kube-api-access-6dk8x\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.395726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovn-node-metrics-cert\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396082 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/db944276-6d28-4640-bf44-d92bdaf38335-etc-tuned\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396186 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-etc-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396252 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-registration-dir\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396299 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-etc-systemd\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396323 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396397 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-daemon-config\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396584 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/087a2888-741d-49e1-88e2-2ad9b12e3a02-cni-binary-copy\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396600 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-sys-fs\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.396613 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs podName:4469b73c-e23d-408d-be6b-656c08681932 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:27.896594388 +0000 UTC m=+3.067251804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs") pod "network-metrics-daemon-7rh6n" (UID: "4469b73c-e23d-408d-be6b-656c08681932") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:27.397438 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396785 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-slash\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396838 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-ovnkube-config\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-node-log\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396922 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-run-openvswitch\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.396988 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62f11e48-e712-4fdc-89ab-22758881823d-kubelet-config\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.397158 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db944276-6d28-4640-bf44-d92bdaf38335-lib-modules\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.397366 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-cni-bin\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.397419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-log-socket\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.397461 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-etc-kubernetes\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.397520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-multus-cni-dir\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.397834 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8c16e95e-e3a3-43be-853a-6e5277355c2c-env-overrides\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.398113 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.397995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7cdc335-ff35-425f-8920-3653c3148dd0-serviceca\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.398688 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.398667 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-iptables-alerter-script\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.398765 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.398739 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-host-var-lib-cni-bin\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.398837 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.398783 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8c16e95e-e3a3-43be-853a-6e5277355c2c-host-cni-netd\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.398837 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.398841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/087a2888-741d-49e1-88e2-2ad9b12e3a02-os-release\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.399447 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.399423 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db944276-6d28-4640-bf44-d92bdaf38335-tmp\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.402426 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.402402 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvt8h\" (UniqueName: \"kubernetes.io/projected/c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6-kube-api-access-tvt8h\") pod \"iptables-alerter-xhk4j\" (UID: \"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6\") " pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.404650 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.404504 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6frdn\" (UniqueName: \"kubernetes.io/projected/a7cdc335-ff35-425f-8920-3653c3148dd0-kube-api-access-6frdn\") pod \"node-ca-m2mrj\" (UID: \"a7cdc335-ff35-425f-8920-3653c3148dd0\") " pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.404650 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.404608 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8msl\" (UniqueName: \"kubernetes.io/projected/db944276-6d28-4640-bf44-d92bdaf38335-kube-api-access-t8msl\") pod \"tuned-7c662\" (UID: \"db944276-6d28-4640-bf44-d92bdaf38335\") " pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.406391 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.406366 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2kr8\" (UniqueName: \"kubernetes.io/projected/a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9-kube-api-access-j2kr8\") pod \"aws-ebs-csi-driver-node-xrtq2\" (UID: \"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.406812 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.406790 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dk8x\" (UniqueName: \"kubernetes.io/projected/8c16e95e-e3a3-43be-853a-6e5277355c2c-kube-api-access-6dk8x\") pod \"ovnkube-node-tmhl7\" (UID: \"8c16e95e-e3a3-43be-853a-6e5277355c2c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.407260 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.407238 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqrr7\" (UniqueName: \"kubernetes.io/projected/087a2888-741d-49e1-88e2-2ad9b12e3a02-kube-api-access-jqrr7\") pod \"multus-gz5dt\" (UID: \"087a2888-741d-49e1-88e2-2ad9b12e3a02\") " pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.407459 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.407442 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqlz\" (UniqueName: \"kubernetes.io/projected/4469b73c-e23d-408d-be6b-656c08681932-kube-api-access-lmqlz\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:27.419056 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.419029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4tf58" Jul 15 22:16:27.426038 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.426021 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" Jul 15 22:16:27.429509 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:27.429477 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91881515_819d_4d72_af89_5a346c2df818.slice/crio-10346b418f6d35779aa4475a5a2bbbcfad65297e42967b5bae7f446b3686f6da WatchSource:0}: Error finding container 10346b418f6d35779aa4475a5a2bbbcfad65297e42967b5bae7f446b3686f6da: Status 404 returned error can't find the container with id 10346b418f6d35779aa4475a5a2bbbcfad65297e42967b5bae7f446b3686f6da Jul 15 22:16:27.436786 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:27.436769 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc780bef1_c7eb_422f_a162_bd84f5ef20ca.slice/crio-21e1af8ef33c5f9ae92aa490aedc6b306d19e48aef64f51fc8cfeee64fa3d709 WatchSource:0}: Error finding container 21e1af8ef33c5f9ae92aa490aedc6b306d19e48aef64f51fc8cfeee64fa3d709: Status 404 returned error can't find the container with id 21e1af8ef33c5f9ae92aa490aedc6b306d19e48aef64f51fc8cfeee64fa3d709 Jul 15 22:16:27.438969 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.438944 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xhk4j" Jul 15 22:16:27.446544 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.446496 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m2mrj" Jul 15 22:16:27.447469 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:27.447445 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07101e0_d33a_42e7_ac7d_fac3ba7f9ab6.slice/crio-84fb5afbc40b177913ad0a72ce622105e3f70edda881a3e126532719082e9ab6 WatchSource:0}: Error finding container 84fb5afbc40b177913ad0a72ce622105e3f70edda881a3e126532719082e9ab6: Status 404 returned error can't find the container with id 84fb5afbc40b177913ad0a72ce622105e3f70edda881a3e126532719082e9ab6 Jul 15 22:16:27.454129 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.453973 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gz5dt" Jul 15 22:16:27.454673 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:27.454645 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7cdc335_ff35_425f_8920_3653c3148dd0.slice/crio-1b6f0fa693a045329a42f28d6bf2ce6ef66d9e8b8e6f908b50e30ee7a8e9e27f WatchSource:0}: Error finding container 1b6f0fa693a045329a42f28d6bf2ce6ef66d9e8b8e6f908b50e30ee7a8e9e27f: Status 404 returned error can't find the container with id 1b6f0fa693a045329a42f28d6bf2ce6ef66d9e8b8e6f908b50e30ee7a8e9e27f Jul 15 22:16:27.462952 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.462933 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7c662" Jul 15 22:16:27.472960 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:27.472937 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb944276_6d28_4640_bf44_d92bdaf38335.slice/crio-225a74bea5bbc71239d0aabd8a0901ab6f086e63707bf2455ec7cb524698b991 WatchSource:0}: Error finding container 225a74bea5bbc71239d0aabd8a0901ab6f086e63707bf2455ec7cb524698b991: Status 404 returned error can't find the container with id 225a74bea5bbc71239d0aabd8a0901ab6f086e63707bf2455ec7cb524698b991 Jul 15 22:16:27.474778 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.474756 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" Jul 15 22:16:27.480954 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.480935 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:27.484443 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:16:27.484404 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda75f96bf_4c86_4dc8_95bc_ecfacaf5f6c9.slice/crio-208b62d420673857a3b735b523cb4ba71316ce7d480b7b9d8e31de34763044e3 WatchSource:0}: Error finding container 208b62d420673857a3b735b523cb4ba71316ce7d480b7b9d8e31de34763044e3: Status 404 returned error can't find the container with id 208b62d420673857a3b735b523cb4ba71316ce7d480b7b9d8e31de34763044e3 Jul 15 22:16:27.799807 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.799774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:27.799972 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.799954 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:16:27.800010 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.799979 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:16:27.800010 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.799992 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2b542 for pod openshift-network-diagnostics/network-check-target-jrzdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:27.800100 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.800053 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542 podName:64ee5b66-5658-44f6-af78-803a3f987af6 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:28.800031944 +0000 UTC m=+3.970689373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b542" (UniqueName: "kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542") pod "network-check-target-jrzdp" (UID: "64ee5b66-5658-44f6-af78-803a3f987af6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:27.901140 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.900391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:27.901140 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:27.900449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:27.901140 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.900598 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:27.901140 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.900657 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs podName:4469b73c-e23d-408d-be6b-656c08681932 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:28.90063745 +0000 UTC m=+4.071294871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs") pod "network-metrics-daemon-7rh6n" (UID: "4469b73c-e23d-408d-be6b-656c08681932") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:27.901140 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.901053 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:27.901140 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:27.901107 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret podName:62f11e48-e712-4fdc-89ab-22758881823d nodeName:}" failed. No retries permitted until 2026-07-15 22:16:28.901091007 +0000 UTC m=+4.071748422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret") pod "global-pull-secret-syncer-hp4bm" (UID: "62f11e48-e712-4fdc-89ab-22758881823d") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:28.223721 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.223610 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:11:27 +0000 UTC" deadline="2028-04-12 14:58:05.415115076 +0000 UTC" Jul 15 22:16:28.223721 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.223673 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15280h41m37.191446217s" Jul 15 22:16:28.377135 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.377014 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xhk4j" event={"ID":"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6","Type":"ContainerStarted","Data":"84fb5afbc40b177913ad0a72ce622105e3f70edda881a3e126532719082e9ab6"} Jul 15 22:16:28.382259 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.382151 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"7f608ce143c2d595cffd333b7611025cb4e10d9abd0eed413762ce589d00f1b2"} Jul 15 22:16:28.383741 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.383717 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" event={"ID":"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9","Type":"ContainerStarted","Data":"208b62d420673857a3b735b523cb4ba71316ce7d480b7b9d8e31de34763044e3"} Jul 15 22:16:28.387572 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.387502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" event={"ID":"c780bef1-c7eb-422f-a162-bd84f5ef20ca","Type":"ContainerStarted","Data":"21e1af8ef33c5f9ae92aa490aedc6b306d19e48aef64f51fc8cfeee64fa3d709"} Jul 15 22:16:28.392041 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.391991 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tf58" event={"ID":"91881515-819d-4d72-af89-5a346c2df818","Type":"ContainerStarted","Data":"10346b418f6d35779aa4475a5a2bbbcfad65297e42967b5bae7f446b3686f6da"} Jul 15 22:16:28.394950 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.394920 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9t8qj" event={"ID":"225cb751-612d-4b5f-b46c-18468dd0b23c","Type":"ContainerStarted","Data":"f30b8ebb147feab941014cd4c9784b2acef2c26aeecddddba6bc6fadf783aa6f"} Jul 15 22:16:28.399390 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.399353 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7c662" event={"ID":"db944276-6d28-4640-bf44-d92bdaf38335","Type":"ContainerStarted","Data":"225a74bea5bbc71239d0aabd8a0901ab6f086e63707bf2455ec7cb524698b991"} Jul 15 22:16:28.403703 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.403677 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gz5dt" event={"ID":"087a2888-741d-49e1-88e2-2ad9b12e3a02","Type":"ContainerStarted","Data":"ab3e59fa366a3641ea4772e381e063b2dede97516cc5c1afbbca1f2d21ee2204"} Jul 15 22:16:28.406516 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.406463 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2mrj" event={"ID":"a7cdc335-ff35-425f-8920-3653c3148dd0","Type":"ContainerStarted","Data":"1b6f0fa693a045329a42f28d6bf2ce6ef66d9e8b8e6f908b50e30ee7a8e9e27f"} Jul 15 22:16:28.807387 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.807348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:28.807569 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:28.807546 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:16:28.807569 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:28.807570 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:16:28.807674 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:28.807583 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2b542 for pod openshift-network-diagnostics/network-check-target-jrzdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:28.807674 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:28.807640 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542 podName:64ee5b66-5658-44f6-af78-803a3f987af6 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:30.807621801 +0000 UTC m=+5.978279218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b542" (UniqueName: "kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542") pod "network-check-target-jrzdp" (UID: "64ee5b66-5658-44f6-af78-803a3f987af6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:28.907876 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.907768 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:28.908054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:28.907939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:28.908128 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:28.908069 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:28.908182 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:28.908133 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret podName:62f11e48-e712-4fdc-89ab-22758881823d nodeName:}" failed. No retries permitted until 2026-07-15 22:16:30.908115651 +0000 UTC m=+6.078773067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret") pod "global-pull-secret-syncer-hp4bm" (UID: "62f11e48-e712-4fdc-89ab-22758881823d") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:28.908574 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:28.908531 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:28.908682 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:28.908584 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs podName:4469b73c-e23d-408d-be6b-656c08681932 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:30.908568914 +0000 UTC m=+6.079226331 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs") pod "network-metrics-daemon-7rh6n" (UID: "4469b73c-e23d-408d-be6b-656c08681932") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:29.224262 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:29.224150 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 22:11:27 +0000 UTC" deadline="2028-02-07 16:16:46.890524344 +0000 UTC" Jul 15 22:16:29.224262 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:29.224215 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13722h0m17.666312833s" Jul 15 22:16:29.369176 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:29.368336 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:29.369176 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:29.368455 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:29.369176 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:29.368844 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:29.369176 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:29.368935 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:29.369176 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:29.368998 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:29.369176 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:29.369085 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:30.825397 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:30.825359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:30.825863 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:30.825534 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:16:30.825863 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:30.825558 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:16:30.825863 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:30.825572 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2b542 for pod openshift-network-diagnostics/network-check-target-jrzdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:30.825863 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:30.825626 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542 podName:64ee5b66-5658-44f6-af78-803a3f987af6 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:34.825607747 +0000 UTC m=+9.996265181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b542" (UniqueName: "kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542") pod "network-check-target-jrzdp" (UID: "64ee5b66-5658-44f6-af78-803a3f987af6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:30.926162 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:30.926126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:30.926362 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:30.926186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:30.926362 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:30.926315 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:30.926482 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:30.926374 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs podName:4469b73c-e23d-408d-be6b-656c08681932 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:34.926353627 +0000 UTC m=+10.097011044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs") pod "network-metrics-daemon-7rh6n" (UID: "4469b73c-e23d-408d-be6b-656c08681932") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:30.926794 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:30.926748 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:30.926865 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:30.926798 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret podName:62f11e48-e712-4fdc-89ab-22758881823d nodeName:}" failed. No retries permitted until 2026-07-15 22:16:34.926783198 +0000 UTC m=+10.097440629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret") pod "global-pull-secret-syncer-hp4bm" (UID: "62f11e48-e712-4fdc-89ab-22758881823d") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:31.365744 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:31.365687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:31.365949 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:31.365854 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:31.366254 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:31.366231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:31.366403 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:31.366380 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:31.366477 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:31.366458 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:31.366574 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:31.366557 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:33.366650 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:33.366561 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:33.367093 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:33.366688 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:33.367149 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:33.367108 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:33.367223 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:33.367199 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:33.367315 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:33.367276 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:33.367414 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:33.367397 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:34.860246 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:34.860158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:34.860722 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:34.860319 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:16:34.860722 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:34.860345 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:16:34.860722 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:34.860358 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2b542 for pod openshift-network-diagnostics/network-check-target-jrzdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:34.860722 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:34.860427 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542 podName:64ee5b66-5658-44f6-af78-803a3f987af6 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:42.86040699 +0000 UTC m=+18.031064420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b542" (UniqueName: "kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542") pod "network-check-target-jrzdp" (UID: "64ee5b66-5658-44f6-af78-803a3f987af6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:34.962064 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:34.961518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:34.962064 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:34.961613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:34.962064 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:34.961671 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:34.962064 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:34.961713 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:34.962064 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:34.961748 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs podName:4469b73c-e23d-408d-be6b-656c08681932 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:42.961728176 +0000 UTC m=+18.132385649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs") pod "network-metrics-daemon-7rh6n" (UID: "4469b73c-e23d-408d-be6b-656c08681932") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:34.962064 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:34.961774 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret podName:62f11e48-e712-4fdc-89ab-22758881823d nodeName:}" failed. No retries permitted until 2026-07-15 22:16:42.96176462 +0000 UTC m=+18.132422036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret") pod "global-pull-secret-syncer-hp4bm" (UID: "62f11e48-e712-4fdc-89ab-22758881823d") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:35.366523 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:35.366486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:35.366697 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:35.366597 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:35.366697 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:35.366653 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:35.366803 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:35.366726 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:35.367199 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:35.367057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:35.367199 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:35.367161 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:37.365874 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:37.365777 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:37.366319 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:37.365907 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:37.366319 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:37.365955 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:37.366319 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:37.365910 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:37.366319 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:37.366033 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:37.366319 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:37.366104 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:39.368427 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:39.368396 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:39.368865 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:39.368396 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:39.368865 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:39.368512 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:39.368865 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:39.368401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:39.368865 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:39.368578 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:39.368865 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:39.368666 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:41.366496 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:41.366465 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:41.366834 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:41.366465 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:41.366834 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:41.366593 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:41.366834 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:41.366467 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:41.366834 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:41.366665 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:41.366834 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:41.366759 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:42.925765 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:42.925673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:42.926169 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:42.925817 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:16:42.926169 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:42.925837 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:16:42.926169 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:42.925846 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2b542 for pod openshift-network-diagnostics/network-check-target-jrzdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:42.926169 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:42.925905 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542 podName:64ee5b66-5658-44f6-af78-803a3f987af6 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:58.92588633 +0000 UTC m=+34.096543763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b542" (UniqueName: "kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542") pod "network-check-target-jrzdp" (UID: "64ee5b66-5658-44f6-af78-803a3f987af6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:43.026641 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:43.026594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:43.026792 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:43.026650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:43.026792 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:43.026756 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:43.026895 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:43.026808 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs podName:4469b73c-e23d-408d-be6b-656c08681932 nodeName:}" failed. No retries permitted until 2026-07-15 22:16:59.026794608 +0000 UTC m=+34.197452021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs") pod "network-metrics-daemon-7rh6n" (UID: "4469b73c-e23d-408d-be6b-656c08681932") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:43.026895 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:43.026758 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:43.026981 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:43.026903 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret podName:62f11e48-e712-4fdc-89ab-22758881823d nodeName:}" failed. No retries permitted until 2026-07-15 22:16:59.026884412 +0000 UTC m=+34.197541844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret") pod "global-pull-secret-syncer-hp4bm" (UID: "62f11e48-e712-4fdc-89ab-22758881823d") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:43.366394 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:43.366305 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:43.366394 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:43.366350 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:43.366613 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:43.366317 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:43.366613 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:43.366438 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:43.366613 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:43.366537 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:43.366613 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:43.366604 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:45.366569 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:45.366385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:45.366990 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:45.366474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:45.366990 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:45.366647 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:45.366990 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:45.366526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:45.366990 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:45.366699 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:45.366990 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:45.366779 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:47.366229 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.366035 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:47.367220 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.366055 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:47.367220 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:47.366347 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:47.367220 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.366099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:47.367220 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:47.366367 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:47.367220 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:47.366466 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:47.439449 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.439378 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gz5dt" event={"ID":"087a2888-741d-49e1-88e2-2ad9b12e3a02","Type":"ContainerStarted","Data":"589fc136b5a36d3acb7fc1ae25977a494abca7b5bb7f0da95db9029afd854754"} Jul 15 22:16:47.440754 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.440728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m2mrj" event={"ID":"a7cdc335-ff35-425f-8920-3653c3148dd0","Type":"ContainerStarted","Data":"4d57258d08b9952a80f35e8a1b50b620ab635ed7599acfc0fe7e4972adb1ac19"} Jul 15 22:16:47.442139 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.442117 2564 generic.go:356] "Generic (PLEG): container finished" podID="d2715b6aef39cde3c38b00cf62da2e9d" containerID="f58a9e7e8311a54b2a570473a89e9ac77fff3743591d4f22d5bf558eb8f75b8c" exitCode=0 Jul 15 22:16:47.442230 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.442198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" event={"ID":"d2715b6aef39cde3c38b00cf62da2e9d","Type":"ContainerDied","Data":"f58a9e7e8311a54b2a570473a89e9ac77fff3743591d4f22d5bf558eb8f75b8c"} Jul 15 22:16:47.445327 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.445310 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"c54658b56f651b2b6365d676ef5b670752936a441b825e1d63317311e58a1f55"} Jul 15 22:16:47.445413 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.445376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"e9396d5e6ee44d5b6a90a9391eb67c660e336cdd6141de3ac04fa7ba074f8793"} Jul 15 22:16:47.445461 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.445427 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"60c97d6ce0911a4f2f82604fb5b08e4f9e9c72f57fd41489355f6bab2c6f28e5"} Jul 15 22:16:47.445502 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.445490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"03a518fcd1d34eafdc67d4aac1906c140a3b4e71aa538031fd7d9243e35f7757"} Jul 15 22:16:47.445549 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.445536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"1d150984a8900e83341bf6df7fa843b035b9013144175d0b4b2bc6349568456c"} Jul 15 22:16:47.445586 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.445571 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"55c194e8a595dd104279322e7289929d0999879f6e76c260300993b394a65e5c"} Jul 15 22:16:47.446575 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.446558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" event={"ID":"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9","Type":"ContainerStarted","Data":"8ef6e191f9ade1762e84b9186d99eaf705a7bb90a5fc27a0a5798392a5947a3e"} Jul 15 22:16:47.447867 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.447839 2564 generic.go:356] "Generic (PLEG): container finished" podID="c780bef1-c7eb-422f-a162-bd84f5ef20ca" containerID="0e6e5b066c7df63e959b990fe591a5c0817508fc4081c84433a299ab3c44476e" exitCode=0 Jul 15 22:16:47.447941 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.447915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" event={"ID":"c780bef1-c7eb-422f-a162-bd84f5ef20ca","Type":"ContainerDied","Data":"0e6e5b066c7df63e959b990fe591a5c0817508fc4081c84433a299ab3c44476e"} Jul 15 22:16:47.449312 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.449272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4tf58" event={"ID":"91881515-819d-4d72-af89-5a346c2df818","Type":"ContainerStarted","Data":"4501820a8fb4aab65595360b0d6b48074c0c84a9e51e74ed474c0841d309257d"} Jul 15 22:16:47.450829 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.450809 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9t8qj" event={"ID":"225cb751-612d-4b5f-b46c-18468dd0b23c","Type":"ContainerStarted","Data":"5aa9c6f82b3cc0979926d0f8c87b232b673f0ec68d3d6c3efbde675743f69031"} Jul 15 22:16:47.452691 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.452645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" event={"ID":"975caee66701c49e86b719a0cf012f15","Type":"ContainerStarted","Data":"4250176c963f27f918eec7ec9bc2ae0fde7fa5993f5edb5eef982ebfe28f4251"} Jul 15 22:16:47.454272 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.454252 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7c662" event={"ID":"db944276-6d28-4640-bf44-d92bdaf38335","Type":"ContainerStarted","Data":"af9993b005e05a080dd82572410b40fdf7eb8cb91179782aada4c0800712f1a3"} Jul 15 22:16:47.458269 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.458212 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gz5dt" podStartSLOduration=3.296590619 podStartE2EDuration="22.458195832s" totalImagesPullingTime="19.161605213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.457047409 +0000 UTC m=+22.627704839" watchObservedRunningTime="2026-07-15 22:16:47.458195832 +0000 UTC m=+22.628853264" Jul 15 22:16:47.486155 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.485974 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-87.ec2.internal" podStartSLOduration=21.485957999 podStartE2EDuration="21.485957999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.47096989 +0000 UTC m=+22.641627326" watchObservedRunningTime="2026-07-15 22:16:47.485957999 +0000 UTC m=+22.656615437" Jul 15 22:16:47.503938 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.503712 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9t8qj" podStartSLOduration=3.282300244 podStartE2EDuration="22.50369566s" totalImagesPullingTime="19.221395416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.503464978 +0000 UTC m=+22.674122415" watchObservedRunningTime="2026-07-15 22:16:47.50369566 +0000 UTC m=+22.674353097" Jul 15 22:16:47.518543 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.518506 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4tf58" podStartSLOduration=3.324846881 podStartE2EDuration="22.518493242s" totalImagesPullingTime="19.193646361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.518017705 +0000 UTC m=+22.688675142" watchObservedRunningTime="2026-07-15 22:16:47.518493242 +0000 UTC m=+22.689150679" Jul 15 22:16:47.571043 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.570993 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7c662" podStartSLOduration=3.420308317 podStartE2EDuration="22.570975067s" totalImagesPullingTime="19.15066675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.570838003 +0000 UTC m=+22.741495439" watchObservedRunningTime="2026-07-15 22:16:47.570975067 +0000 UTC m=+22.741632503" Jul 15 22:16:47.571355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:47.571321 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m2mrj" podStartSLOduration=3.403069458 podStartE2EDuration="22.571309247s" totalImagesPullingTime="19.168239789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:47.554184609 +0000 UTC m=+22.724842045" watchObservedRunningTime="2026-07-15 22:16:47.571309247 +0000 UTC m=+22.741966679" Jul 15 22:16:48.181452 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.181424 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 22:16:48.246146 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.246050 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T22:16:48.181447116Z","UUID":"c43094e4-6030-4c57-9024-d56a9f291be9","Handler":null,"Name":"","Endpoint":""} Jul 15 22:16:48.247534 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.247512 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 22:16:48.247637 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.247556 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 22:16:48.458035 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.457995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xhk4j" event={"ID":"c07101e0-d33a-42e7-ac7d-fac3ba7f9ab6","Type":"ContainerStarted","Data":"84a3d307e70bff816a51179e3e5b72442446c5b45b40eb2747d64b6a7d0d6920"} Jul 15 22:16:48.460043 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.460012 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" event={"ID":"d2715b6aef39cde3c38b00cf62da2e9d","Type":"ContainerStarted","Data":"d27cbeb25a09516bf56ac553256377e8e911b109f1682482dc99a45005580b84"} Jul 15 22:16:48.462247 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.462181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" event={"ID":"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9","Type":"ContainerStarted","Data":"0e3c25849b4f32942f81534d62121a02b2f719335dc4f1e3fbd0cd2ad3ed849c"} Jul 15 22:16:48.478659 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.478624 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xhk4j" podStartSLOduration=4.302304531 podStartE2EDuration="23.478611359s" totalImagesPullingTime="19.176306828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:48.4783621 +0000 UTC m=+23.649019537" watchObservedRunningTime="2026-07-15 22:16:48.478611359 +0000 UTC m=+23.649268794" Jul 15 22:16:48.499325 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:48.499269 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-87.ec2.internal" podStartSLOduration=22.499255168 podStartE2EDuration="22.499255168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:48.498947363 +0000 UTC m=+23.669604801" watchObservedRunningTime="2026-07-15 22:16:48.499255168 +0000 UTC m=+23.669912601" Jul 15 22:16:49.366080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:49.366050 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:49.366231 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:49.366085 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:49.366231 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:49.366051 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:49.366231 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:49.366184 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:49.366416 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:49.366256 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:49.366416 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:49.366347 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:50.470415 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:50.470374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"a9e9563b53c224daf3e0711971daa2e49bd6ba0e22399e92651dc853408f8449"} Jul 15 22:16:50.472849 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:50.472818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" event={"ID":"a75f96bf-4c86-4dc8-95bc-ecfacaf5f6c9","Type":"ContainerStarted","Data":"7a5999bb6eab20fb53bf19512efbf78f199c57284917af0688b61738687d970e"} Jul 15 22:16:51.006892 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:51.006848 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:51.007649 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:51.007616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:51.024409 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:51.024371 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrtq2" podStartSLOduration=4.508501445 podStartE2EDuration="26.02435531s" totalImagesPullingTime="21.515853865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:50.498243965 +0000 UTC m=+25.668901401" watchObservedRunningTime="2026-07-15 22:16:51.02435531 +0000 UTC m=+26.195012748" Jul 15 22:16:51.325327 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:51.325227 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:51.325828 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:51.325801 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9t8qj" Jul 15 22:16:51.366251 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:51.366219 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:51.366251 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:51.366239 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:51.366459 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:51.366350 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:51.366459 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:51.366414 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:51.366459 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:51.366443 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:51.366602 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:51.366541 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:52.480167 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:52.479903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" event={"ID":"8c16e95e-e3a3-43be-853a-6e5277355c2c","Type":"ContainerStarted","Data":"972864ebaabce24c0bfd5b0cb704a8ce64529db7b9708374bace1e455784badc"} Jul 15 22:16:52.480837 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:52.480191 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:52.480837 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:52.480247 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:52.481809 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:52.481780 2564 generic.go:356] "Generic (PLEG): container finished" podID="c780bef1-c7eb-422f-a162-bd84f5ef20ca" containerID="6ef223e9166248577b1bfa95f566f31aadd237b66f17e8b490ddd90207e920e1" exitCode=0 Jul 15 22:16:52.481917 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:52.481872 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" event={"ID":"c780bef1-c7eb-422f-a162-bd84f5ef20ca","Type":"ContainerDied","Data":"6ef223e9166248577b1bfa95f566f31aadd237b66f17e8b490ddd90207e920e1"} Jul 15 22:16:52.495280 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:52.495262 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:52.511156 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:52.511119 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" podStartSLOduration=8.283281311 podStartE2EDuration="27.511107989s" totalImagesPullingTime="19.227826678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:16:52.510605211 +0000 UTC m=+27.681262672" watchObservedRunningTime="2026-07-15 22:16:52.511107989 +0000 UTC m=+27.681765455" Jul 15 22:16:53.366507 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:53.366446 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:53.366507 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:53.366454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:53.366709 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:53.366624 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:53.366709 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:53.366671 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:53.366778 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:53.366742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:53.366853 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:53.366836 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:53.483956 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:53.483926 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:53.497699 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:53.497679 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:16:54.487267 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:54.487231 2564 generic.go:356] "Generic (PLEG): container finished" podID="c780bef1-c7eb-422f-a162-bd84f5ef20ca" containerID="6593c5f8005ab883c1871fc095a532eef6521f04dab6f7d9392a1691ec27d65a" exitCode=0 Jul 15 22:16:54.487782 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:54.487318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" event={"ID":"c780bef1-c7eb-422f-a162-bd84f5ef20ca","Type":"ContainerDied","Data":"6593c5f8005ab883c1871fc095a532eef6521f04dab6f7d9392a1691ec27d65a"} Jul 15 22:16:55.366318 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:55.366275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:55.366472 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:55.366374 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:55.366472 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:55.366392 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:55.366472 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:55.366413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:55.366569 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:55.366502 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:55.366607 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:55.366588 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:56.254071 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:56.253892 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrzdp"] Jul 15 22:16:56.254463 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:56.254183 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:56.254463 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:56.254265 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:56.257097 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:56.257071 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7rh6n"] Jul 15 22:16:56.257236 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:56.257175 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:56.257319 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:56.257263 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:56.257716 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:56.257687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hp4bm"] Jul 15 22:16:56.257822 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:56.257793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:56.257907 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:56.257884 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:56.494071 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:56.494041 2564 generic.go:356] "Generic (PLEG): container finished" podID="c780bef1-c7eb-422f-a162-bd84f5ef20ca" containerID="663be769b5203750ab9e26137c64f09316ab1699b0f193101f95a16a6674b20a" exitCode=0 Jul 15 22:16:56.494243 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:56.494083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" event={"ID":"c780bef1-c7eb-422f-a162-bd84f5ef20ca","Type":"ContainerDied","Data":"663be769b5203750ab9e26137c64f09316ab1699b0f193101f95a16a6674b20a"} Jul 15 22:16:57.366509 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:57.366478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:57.367023 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:57.366615 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:16:58.366453 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:58.366385 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:58.366607 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:58.366506 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:16:58.366607 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:58.366533 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:58.366955 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:58.366652 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:16:58.953543 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:58.953506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:16:58.953751 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:58.953678 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 22:16:58.953751 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:58.953699 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 22:16:58.953751 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:58.953711 2564 projected.go:196] Error preparing data for projected volume kube-api-access-2b542 for pod openshift-network-diagnostics/network-check-target-jrzdp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:58.953892 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:58.953784 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542 podName:64ee5b66-5658-44f6-af78-803a3f987af6 nodeName:}" failed. No retries permitted until 2026-07-15 22:17:30.953766927 +0000 UTC m=+66.124424340 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2b542" (UniqueName: "kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542") pod "network-check-target-jrzdp" (UID: "64ee5b66-5658-44f6-af78-803a3f987af6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 22:16:59.054665 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:59.054637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:59.054871 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:59.054683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:16:59.054871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:59.054786 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:59.054871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:59.054790 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:59.054871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:59.054838 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs podName:4469b73c-e23d-408d-be6b-656c08681932 nodeName:}" failed. No retries permitted until 2026-07-15 22:17:31.054823641 +0000 UTC m=+66.225481055 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs") pod "network-metrics-daemon-7rh6n" (UID: "4469b73c-e23d-408d-be6b-656c08681932") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 22:16:59.054871 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:59.054855 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret podName:62f11e48-e712-4fdc-89ab-22758881823d nodeName:}" failed. No retries permitted until 2026-07-15 22:17:31.054846281 +0000 UTC m=+66.225503698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret") pod "global-pull-secret-syncer-hp4bm" (UID: "62f11e48-e712-4fdc-89ab-22758881823d") : object "kube-system"/"original-pull-secret" not registered Jul 15 22:16:59.366078 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:16:59.366009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:16:59.366317 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:16:59.366115 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp4bm" podUID="62f11e48-e712-4fdc-89ab-22758881823d" Jul 15 22:17:00.366220 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.366178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:17:00.366638 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.366193 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:17:00.366638 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:00.366324 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7rh6n" podUID="4469b73c-e23d-408d-be6b-656c08681932" Jul 15 22:17:00.366638 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:00.366382 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jrzdp" podUID="64ee5b66-5658-44f6-af78-803a3f987af6" Jul 15 22:17:00.576673 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.576602 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-87.ec2.internal" event="NodeReady" Jul 15 22:17:00.576808 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.576746 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 22:17:00.712700 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.712674 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d5j7w"] Jul 15 22:17:00.738390 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.738366 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jnbgx"] Jul 15 22:17:00.738531 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.738482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.750686 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.750547 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ff8j8\"" Jul 15 22:17:00.750686 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.750542 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 22:17:00.750876 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.750829 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 22:17:00.752353 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.752334 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d5j7w"] Jul 15 22:17:00.752466 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.752426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.755970 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.755953 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jnbgx"] Jul 15 22:17:00.759506 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.759470 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 22:17:00.759599 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.759576 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 22:17:00.759658 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.759610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vmsfz\"" Jul 15 22:17:00.759717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.759695 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 22:17:00.759946 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.759930 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 22:17:00.769435 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.769417 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9shlm"] Jul 15 22:17:00.790787 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.790767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9shlm"] Jul 15 22:17:00.790891 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.790862 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9shlm" Jul 15 22:17:00.802939 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.802922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 22:17:00.803016 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.802925 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 22:17:00.803104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.803089 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 22:17:00.803156 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.803092 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vb4mh\"" Jul 15 22:17:00.871809 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.871759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65nnw\" (UniqueName: \"kubernetes.io/projected/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-kube-api-access-65nnw\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.871809 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.871798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-crio-socket\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.871940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.871816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.871940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.871892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34471794-0361-45e0-b1b2-429d0833d689-tmp-dir\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.871940 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.871935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxgm7\" (UniqueName: \"kubernetes.io/projected/34471794-0361-45e0-b1b2-429d0833d689-kube-api-access-kxgm7\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.872041 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.871983 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34471794-0361-45e0-b1b2-429d0833d689-config-volume\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.872041 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.872005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34471794-0361-45e0-b1b2-429d0833d689-metrics-tls\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.872112 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.872045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-data-volume\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.872112 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.872067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.972458 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64057592-8295-4199-a7ab-f61b91b3121e-cert\") pod \"ingress-canary-9shlm\" (UID: \"64057592-8295-4199-a7ab-f61b91b3121e\") " pod="openshift-ingress-canary/ingress-canary-9shlm" Jul 15 22:17:00.972575 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34471794-0361-45e0-b1b2-429d0833d689-tmp-dir\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.972575 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972502 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wccw7\" (UniqueName: \"kubernetes.io/projected/64057592-8295-4199-a7ab-f61b91b3121e-kube-api-access-wccw7\") pod \"ingress-canary-9shlm\" (UID: \"64057592-8295-4199-a7ab-f61b91b3121e\") " pod="openshift-ingress-canary/ingress-canary-9shlm" Jul 15 22:17:00.972575 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxgm7\" (UniqueName: \"kubernetes.io/projected/34471794-0361-45e0-b1b2-429d0833d689-kube-api-access-kxgm7\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.972575 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34471794-0361-45e0-b1b2-429d0833d689-config-volume\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.972788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34471794-0361-45e0-b1b2-429d0833d689-metrics-tls\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.972788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-data-volume\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.972788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.972788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65nnw\" (UniqueName: \"kubernetes.io/projected/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-kube-api-access-65nnw\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.972788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972738 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-crio-socket\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.972788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.972788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.972772 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34471794-0361-45e0-b1b2-429d0833d689-tmp-dir\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.973143 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.973096 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34471794-0361-45e0-b1b2-429d0833d689-config-volume\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.973221 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.973195 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-crio-socket\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.973275 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.973259 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-data-volume\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.973275 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.973259 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.976666 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.976642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:00.976666 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.976655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34471794-0361-45e0-b1b2-429d0833d689-metrics-tls\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.983746 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.983725 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxgm7\" (UniqueName: \"kubernetes.io/projected/34471794-0361-45e0-b1b2-429d0833d689-kube-api-access-kxgm7\") pod \"dns-default-d5j7w\" (UID: \"34471794-0361-45e0-b1b2-429d0833d689\") " pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:00.986086 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:00.986066 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65nnw\" (UniqueName: \"kubernetes.io/projected/52da1a4a-39ed-4b69-b42d-5dbd03e64e07-kube-api-access-65nnw\") pod \"insights-runtime-extractor-jnbgx\" (UID: \"52da1a4a-39ed-4b69-b42d-5dbd03e64e07\") " pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:01.043942 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.043921 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc"] Jul 15 22:17:01.047277 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.047261 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:01.054997 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.054979 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" Jul 15 22:17:01.057836 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.057816 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qfh5b\"" Jul 15 22:17:01.057969 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.057950 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 15 22:17:01.060337 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.060318 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc"] Jul 15 22:17:01.061245 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.061229 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jnbgx" Jul 15 22:17:01.073519 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.073382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64057592-8295-4199-a7ab-f61b91b3121e-cert\") pod \"ingress-canary-9shlm\" (UID: \"64057592-8295-4199-a7ab-f61b91b3121e\") " pod="openshift-ingress-canary/ingress-canary-9shlm" Jul 15 22:17:01.073616 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.073559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wccw7\" (UniqueName: \"kubernetes.io/projected/64057592-8295-4199-a7ab-f61b91b3121e-kube-api-access-wccw7\") pod \"ingress-canary-9shlm\" (UID: \"64057592-8295-4199-a7ab-f61b91b3121e\") " pod="openshift-ingress-canary/ingress-canary-9shlm" Jul 15 22:17:01.075955 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.075935 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64057592-8295-4199-a7ab-f61b91b3121e-cert\") pod \"ingress-canary-9shlm\" (UID: \"64057592-8295-4199-a7ab-f61b91b3121e\") " pod="openshift-ingress-canary/ingress-canary-9shlm" Jul 15 22:17:01.084904 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.084884 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wccw7\" (UniqueName: \"kubernetes.io/projected/64057592-8295-4199-a7ab-f61b91b3121e-kube-api-access-wccw7\") pod \"ingress-canary-9shlm\" (UID: \"64057592-8295-4199-a7ab-f61b91b3121e\") " pod="openshift-ingress-canary/ingress-canary-9shlm" Jul 15 22:17:01.098860 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.098831 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9shlm" Jul 15 22:17:01.174165 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.174058 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/38da7c18-489d-49ff-8f9d-29a833cc40c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kwqdc\" (UID: \"38da7c18-489d-49ff-8f9d-29a833cc40c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" Jul 15 22:17:01.262011 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.261982 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jnbgx"] Jul 15 22:17:01.264552 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.264482 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d5j7w"] Jul 15 22:17:01.274815 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.274769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/38da7c18-489d-49ff-8f9d-29a833cc40c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kwqdc\" (UID: \"38da7c18-489d-49ff-8f9d-29a833cc40c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" Jul 15 22:17:01.274939 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:01.274922 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 15 22:17:01.274996 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:01.274986 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38da7c18-489d-49ff-8f9d-29a833cc40c8-tls-certificates podName:38da7c18-489d-49ff-8f9d-29a833cc40c8 nodeName:}" failed. No retries permitted until 2026-07-15 22:17:01.774970565 +0000 UTC m=+36.945627979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/38da7c18-489d-49ff-8f9d-29a833cc40c8-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-kwqdc" (UID: "38da7c18-489d-49ff-8f9d-29a833cc40c8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 15 22:17:01.283962 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.283928 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9shlm"] Jul 15 22:17:01.287984 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:01.287960 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52da1a4a_39ed_4b69_b42d_5dbd03e64e07.slice/crio-c1861376d214dd5dd1ef76415d660984e4e71fbeaacc65dde895d17bbebd96ee WatchSource:0}: Error finding container c1861376d214dd5dd1ef76415d660984e4e71fbeaacc65dde895d17bbebd96ee: Status 404 returned error can't find the container with id c1861376d214dd5dd1ef76415d660984e4e71fbeaacc65dde895d17bbebd96ee Jul 15 22:17:01.288719 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:01.288693 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64057592_8295_4199_a7ab_f61b91b3121e.slice/crio-0fc9f9e52f417a7f55b5c5c5aa9b30abf5a14f39fa81705cdd26dabe2fa5931d WatchSource:0}: Error finding container 0fc9f9e52f417a7f55b5c5c5aa9b30abf5a14f39fa81705cdd26dabe2fa5931d: Status 404 returned error can't find the container with id 0fc9f9e52f417a7f55b5c5c5aa9b30abf5a14f39fa81705cdd26dabe2fa5931d Jul 15 22:17:01.289568 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:01.289506 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34471794_0361_45e0_b1b2_429d0833d689.slice/crio-b7942c8b1da9605f94bdba95bd41189c2592bd0eb62c421720013b06634016a1 WatchSource:0}: Error finding container b7942c8b1da9605f94bdba95bd41189c2592bd0eb62c421720013b06634016a1: Status 404 returned error can't find the container with id b7942c8b1da9605f94bdba95bd41189c2592bd0eb62c421720013b06634016a1 Jul 15 22:17:01.368915 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.368894 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:17:01.371665 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.371648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 22:17:01.507027 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.506992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5j7w" event={"ID":"34471794-0361-45e0-b1b2-429d0833d689","Type":"ContainerStarted","Data":"b7942c8b1da9605f94bdba95bd41189c2592bd0eb62c421720013b06634016a1"} Jul 15 22:17:01.509514 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.509492 2564 generic.go:356] "Generic (PLEG): container finished" podID="c780bef1-c7eb-422f-a162-bd84f5ef20ca" containerID="bbf2c5657f3d66b6239c6ebcc52d5ddc4be2c6abba2d1df0565d67c4593cd603" exitCode=0 Jul 15 22:17:01.509616 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.509557 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" event={"ID":"c780bef1-c7eb-422f-a162-bd84f5ef20ca","Type":"ContainerDied","Data":"bbf2c5657f3d66b6239c6ebcc52d5ddc4be2c6abba2d1df0565d67c4593cd603"} Jul 15 22:17:01.510691 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.510655 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnbgx" event={"ID":"52da1a4a-39ed-4b69-b42d-5dbd03e64e07","Type":"ContainerStarted","Data":"c1861376d214dd5dd1ef76415d660984e4e71fbeaacc65dde895d17bbebd96ee"} Jul 15 22:17:01.511614 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.511595 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9shlm" event={"ID":"64057592-8295-4199-a7ab-f61b91b3121e","Type":"ContainerStarted","Data":"0fc9f9e52f417a7f55b5c5c5aa9b30abf5a14f39fa81705cdd26dabe2fa5931d"} Jul 15 22:17:01.777231 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.777200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/38da7c18-489d-49ff-8f9d-29a833cc40c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kwqdc\" (UID: \"38da7c18-489d-49ff-8f9d-29a833cc40c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" Jul 15 22:17:01.780225 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.780066 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/38da7c18-489d-49ff-8f9d-29a833cc40c8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-kwqdc\" (UID: \"38da7c18-489d-49ff-8f9d-29a833cc40c8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" Jul 15 22:17:01.970485 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:01.970449 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" Jul 15 22:17:02.122122 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.122054 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc"] Jul 15 22:17:02.126781 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:02.126749 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38da7c18_489d_49ff_8f9d_29a833cc40c8.slice/crio-909b4d302ca135eec6ac3f1da1f7c53482b531bb2745cede41baa109f071dc60 WatchSource:0}: Error finding container 909b4d302ca135eec6ac3f1da1f7c53482b531bb2745cede41baa109f071dc60: Status 404 returned error can't find the container with id 909b4d302ca135eec6ac3f1da1f7c53482b531bb2745cede41baa109f071dc60 Jul 15 22:17:02.365748 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.365666 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:17:02.366115 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.366094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:17:02.371374 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.370334 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xvxsv\"" Jul 15 22:17:02.371374 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.370638 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 22:17:02.371374 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.370821 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 22:17:02.371374 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.371006 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 22:17:02.371374 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.371164 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rb8hr\"" Jul 15 22:17:02.517737 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.517697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" event={"ID":"38da7c18-489d-49ff-8f9d-29a833cc40c8","Type":"ContainerStarted","Data":"909b4d302ca135eec6ac3f1da1f7c53482b531bb2745cede41baa109f071dc60"} Jul 15 22:17:02.522696 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.521823 2564 generic.go:356] "Generic (PLEG): container finished" podID="c780bef1-c7eb-422f-a162-bd84f5ef20ca" containerID="b4a452e41b6de72a0deb4726ebf4c3f2895b0df81f3a0f81c9834762c4ae40c0" exitCode=0 Jul 15 22:17:02.522696 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:02.521856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" event={"ID":"c780bef1-c7eb-422f-a162-bd84f5ef20ca","Type":"ContainerDied","Data":"b4a452e41b6de72a0deb4726ebf4c3f2895b0df81f3a0f81c9834762c4ae40c0"} Jul 15 22:17:03.187318 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.187271 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb9cfcfc4-7t8t5"] Jul 15 22:17:03.189488 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.189463 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.194022 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.193989 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 22:17:03.194133 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.194023 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 22:17:03.194463 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.194280 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 22:17:03.195258 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.195239 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2b7m5\"" Jul 15 22:17:03.195258 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.195255 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 22:17:03.195520 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.195505 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 22:17:03.195581 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.195538 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 22:17:03.195848 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.195803 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 22:17:03.210304 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.209125 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb9cfcfc4-7t8t5"] Jul 15 22:17:03.211255 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.211012 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 22:17:03.289386 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.289346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-oauth-config\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.289563 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.289398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-serving-cert\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.289563 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.289448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrb7g\" (UniqueName: \"kubernetes.io/projected/ddfacb2d-c653-4246-a50f-7ae3a5be5307-kube-api-access-nrb7g\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.289563 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.289499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-config\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.289563 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.289525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-service-ca\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.289563 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.289549 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-trusted-ca-bundle\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.289838 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.289572 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-oauth-serving-cert\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.390238 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.390205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-oauth-config\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.390728 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.390253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-serving-cert\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.390728 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.390312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrb7g\" (UniqueName: \"kubernetes.io/projected/ddfacb2d-c653-4246-a50f-7ae3a5be5307-kube-api-access-nrb7g\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.390728 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.390341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-config\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.390728 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.390370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-service-ca\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.390728 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.390394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-trusted-ca-bundle\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.390728 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.390418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-oauth-serving-cert\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.391419 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.391093 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-oauth-serving-cert\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.391517 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.391428 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-config\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.392433 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.391635 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-service-ca\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.392433 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.392385 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-trusted-ca-bundle\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.394757 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.394732 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-oauth-config\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.395184 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.395168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-serving-cert\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.400447 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.400422 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrb7g\" (UniqueName: \"kubernetes.io/projected/ddfacb2d-c653-4246-a50f-7ae3a5be5307-kube-api-access-nrb7g\") pod \"console-5cb9cfcfc4-7t8t5\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.501674 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.501606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:03.529847 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.529814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" event={"ID":"c780bef1-c7eb-422f-a162-bd84f5ef20ca","Type":"ContainerStarted","Data":"9ff5b447af4827dfc416c8bf4a564d72872ea9746a18a367765d567bd1dda27f"} Jul 15 22:17:03.556871 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:03.556809 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pvdhq" podStartSLOduration=8.040447985 podStartE2EDuration="38.55678676s" totalImagesPullingTime="30.516338775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:03.555059644 +0000 UTC m=+38.725717082" watchObservedRunningTime="2026-07-15 22:17:03.55678676 +0000 UTC m=+38.727444197" Jul 15 22:17:08.176606 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.176462 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb9cfcfc4-7t8t5"] Jul 15 22:17:08.178773 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:08.178746 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfacb2d_c653_4246_a50f_7ae3a5be5307.slice/crio-b96c89c056684a14f0011589fa621307787aae86b9c82a5fd417dc288887e336 WatchSource:0}: Error finding container b96c89c056684a14f0011589fa621307787aae86b9c82a5fd417dc288887e336: Status 404 returned error can't find the container with id b96c89c056684a14f0011589fa621307787aae86b9c82a5fd417dc288887e336 Jul 15 22:17:08.545393 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.545363 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb9cfcfc4-7t8t5" event={"ID":"ddfacb2d-c653-4246-a50f-7ae3a5be5307","Type":"ContainerStarted","Data":"b96c89c056684a14f0011589fa621307787aae86b9c82a5fd417dc288887e336"} Jul 15 22:17:08.546861 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.546832 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9shlm" event={"ID":"64057592-8295-4199-a7ab-f61b91b3121e","Type":"ContainerStarted","Data":"90cf90d7c918497ab926112654dffb9fe358997fe4ab4066aae907aa50994d4d"} Jul 15 22:17:08.548794 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.548768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5j7w" event={"ID":"34471794-0361-45e0-b1b2-429d0833d689","Type":"ContainerStarted","Data":"00030b9bcf647bacd8708c18616e5929dbd76a66f5bf0ee9eb863d88a606a0f3"} Jul 15 22:17:08.548907 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.548814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5j7w" event={"ID":"34471794-0361-45e0-b1b2-429d0833d689","Type":"ContainerStarted","Data":"781e8dab2f55939bed8ef70eaca219647556fdffafb8afab8db052c1ed4224f6"} Jul 15 22:17:08.548907 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.548860 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:08.550440 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.550417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnbgx" event={"ID":"52da1a4a-39ed-4b69-b42d-5dbd03e64e07","Type":"ContainerStarted","Data":"810c4dba9d0fdfd790352806ec637886dba231a0a0873ea32a52e7b01362c0e4"} Jul 15 22:17:08.551834 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.551815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" event={"ID":"38da7c18-489d-49ff-8f9d-29a833cc40c8","Type":"ContainerStarted","Data":"995edf2262095d178afb43cac1cf4d1f0f86dbb2018c4ffdb0f0b5702d2267f4"} Jul 15 22:17:08.552002 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.551982 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" Jul 15 22:17:08.556673 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.556654 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" Jul 15 22:17:08.575402 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.575364 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9shlm" podStartSLOduration=1.844954762 podStartE2EDuration="8.575349755s" totalImagesPullingTime="6.730394993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:08.575123662 +0000 UTC m=+43.745781099" watchObservedRunningTime="2026-07-15 22:17:08.575349755 +0000 UTC m=+43.746007210" Jul 15 22:17:08.647949 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.647899 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-kwqdc" podStartSLOduration=1.756065284 podStartE2EDuration="7.647884547s" totalImagesPullingTime="5.891819263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:08.607709949 +0000 UTC m=+43.778367384" watchObservedRunningTime="2026-07-15 22:17:08.647884547 +0000 UTC m=+43.818541962" Jul 15 22:17:08.648107 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:08.648082 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d5j7w" podStartSLOduration=2.33105578 podStartE2EDuration="8.64807423s" totalImagesPullingTime="6.31701845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:08.647353919 +0000 UTC m=+43.818011355" watchObservedRunningTime="2026-07-15 22:17:08.64807423 +0000 UTC m=+43.818731668" Jul 15 22:17:09.096827 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.096782 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xtthp"] Jul 15 22:17:09.108588 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.108562 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.111329 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.111304 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 15 22:17:09.111329 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.111321 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 15 22:17:09.113237 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.113133 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 22:17:09.113474 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.113428 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6lw2r\"" Jul 15 22:17:09.113576 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.113480 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 22:17:09.113576 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.113483 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 22:17:09.115873 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.115817 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xtthp"] Jul 15 22:17:09.135472 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.135449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.135592 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.135510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.135592 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.135551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vzqk\" (UniqueName: \"kubernetes.io/projected/65255593-7351-44fd-891f-91ca39f2a91f-kube-api-access-8vzqk\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.135706 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.135597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65255593-7351-44fd-891f-91ca39f2a91f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.236240 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.236199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.236688 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.236259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.236688 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.236300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vzqk\" (UniqueName: \"kubernetes.io/projected/65255593-7351-44fd-891f-91ca39f2a91f-kube-api-access-8vzqk\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.236688 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.236346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65255593-7351-44fd-891f-91ca39f2a91f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.237467 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.237078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/65255593-7351-44fd-891f-91ca39f2a91f-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.237467 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:09.237363 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 15 22:17:09.237467 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:09.237433 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-tls podName:65255593-7351-44fd-891f-91ca39f2a91f nodeName:}" failed. No retries permitted until 2026-07-15 22:17:09.73741249 +0000 UTC m=+44.908069909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-tls") pod "prometheus-operator-64785b6675-xtthp" (UID: "65255593-7351-44fd-891f-91ca39f2a91f") : secret "prometheus-operator-tls" not found Jul 15 22:17:09.240752 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.240707 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.249824 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.249800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vzqk\" (UniqueName: \"kubernetes.io/projected/65255593-7351-44fd-891f-91ca39f2a91f-kube-api-access-8vzqk\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.741171 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.741109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:09.745409 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:09.744781 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/65255593-7351-44fd-891f-91ca39f2a91f-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xtthp\" (UID: \"65255593-7351-44fd-891f-91ca39f2a91f\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:10.020529 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:10.020425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" Jul 15 22:17:10.166674 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:10.166638 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xtthp"] Jul 15 22:17:11.637653 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:11.637623 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65255593_7351_44fd_891f_91ca39f2a91f.slice/crio-ad9e4e542654cfc44c6b46ffb9560198e57091dc6a968249e4a841ca3ff7b331 WatchSource:0}: Error finding container ad9e4e542654cfc44c6b46ffb9560198e57091dc6a968249e4a841ca3ff7b331: Status 404 returned error can't find the container with id ad9e4e542654cfc44c6b46ffb9560198e57091dc6a968249e4a841ca3ff7b331 Jul 15 22:17:12.564465 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:12.564430 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" event={"ID":"65255593-7351-44fd-891f-91ca39f2a91f","Type":"ContainerStarted","Data":"ad9e4e542654cfc44c6b46ffb9560198e57091dc6a968249e4a841ca3ff7b331"} Jul 15 22:17:14.573553 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:14.573517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb9cfcfc4-7t8t5" event={"ID":"ddfacb2d-c653-4246-a50f-7ae3a5be5307","Type":"ContainerStarted","Data":"04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94"} Jul 15 22:17:14.575151 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:14.575129 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnbgx" event={"ID":"52da1a4a-39ed-4b69-b42d-5dbd03e64e07","Type":"ContainerStarted","Data":"8c05f0452a70472c76dfcb77eb3f430a0d2ed203c07994ba7998ac57107ead1d"} Jul 15 22:17:14.601826 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:14.601787 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb9cfcfc4-7t8t5" podStartSLOduration=5.98249765 podStartE2EDuration="11.601773304s" totalImagesPullingTime="5.619275654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:14.600487462 +0000 UTC m=+49.771144897" watchObservedRunningTime="2026-07-15 22:17:14.601773304 +0000 UTC m=+49.772430722" Jul 15 22:17:16.583608 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:16.583565 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" event={"ID":"65255593-7351-44fd-891f-91ca39f2a91f","Type":"ContainerStarted","Data":"3fb5b559356235750df8e2b1ef6a5f46b47402f44238bbc6dcddcaaab3bc4d10"} Jul 15 22:17:16.584038 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:16.583632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" event={"ID":"65255593-7351-44fd-891f-91ca39f2a91f","Type":"ContainerStarted","Data":"cf9714f5f8fb1ebd8c3a891e8e7e228e3be608420e1a0f4ed4673d87ebd4505b"} Jul 15 22:17:16.599847 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:16.599807 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-xtthp" podStartSLOduration=3.3352607819999998 podStartE2EDuration="7.599791831s" totalImagesPullingTime="4.264531049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:16.599512115 +0000 UTC m=+51.770169550" watchObservedRunningTime="2026-07-15 22:17:16.599791831 +0000 UTC m=+51.770449269" Jul 15 22:17:18.557365 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.557331 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d5j7w" Jul 15 22:17:18.581102 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.581076 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5"] Jul 15 22:17:18.583061 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.583047 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.587086 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.587042 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 22:17:18.587208 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.587188 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-64jtb\"" Jul 15 22:17:18.588044 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.588023 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 22:17:18.588419 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.588392 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gjf2w"] Jul 15 22:17:18.591045 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.591026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.592922 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.592903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jnbgx" event={"ID":"52da1a4a-39ed-4b69-b42d-5dbd03e64e07","Type":"ContainerStarted","Data":"992445b36c86634983afd349f0813137d247a084d7a9a3d13a29101f1d5bc694"} Jul 15 22:17:18.597432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.597416 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 22:17:18.602227 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.602208 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 22:17:18.602346 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.602304 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qc2q4\"" Jul 15 22:17:18.602481 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.602467 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 22:17:18.603150 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.603134 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5"] Jul 15 22:17:18.614727 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.614807 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a17e1c-4406-4803-9e5f-11f13e67824c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.614807 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-tls\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.614807 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-wtmp\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.614905 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.614905 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-root\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.614905 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-accelerators-collector-config\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.614996 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614953 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-textfile\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.614996 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.614985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.615056 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.615035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx9hp\" (UniqueName: \"kubernetes.io/projected/45a17e1c-4406-4803-9e5f-11f13e67824c-kube-api-access-hx9hp\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.615094 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.615053 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-sys\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.615094 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.615081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdcbcda4-adab-4393-81e6-e099ecea7587-metrics-client-ca\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.615164 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.615142 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdqmj\" (UniqueName: \"kubernetes.io/projected/cdcbcda4-adab-4393-81e6-e099ecea7587-kube-api-access-fdqmj\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.713257 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.713208 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jnbgx" podStartSLOduration=2.433016539 podStartE2EDuration="18.713193518s" totalImagesPullingTime="16.280176979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:17:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:18.682060937 +0000 UTC m=+53.852718373" watchObservedRunningTime="2026-07-15 22:17:18.713193518 +0000 UTC m=+53.883850953" Jul 15 22:17:18.715980 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.715961 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdqmj\" (UniqueName: \"kubernetes.io/projected/cdcbcda4-adab-4393-81e6-e099ecea7587-kube-api-access-fdqmj\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716055 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.716093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a17e1c-4406-4803-9e5f-11f13e67824c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.716093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-tls\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-wtmp\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.716183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716149 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-root\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716183 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:18.716154 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 15 22:17:18.716183 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-accelerators-collector-config\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716432 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:18.716212 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls podName:45a17e1c-4406-4803-9e5f-11f13e67824c nodeName:}" failed. No retries permitted until 2026-07-15 22:17:19.216194671 +0000 UTC m=+54.386852086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-qhfm5" (UID: "45a17e1c-4406-4803-9e5f-11f13e67824c") : secret "openshift-state-metrics-tls" not found Jul 15 22:17:18.716432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-textfile\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716274 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-wtmp\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx9hp\" (UniqueName: \"kubernetes.io/projected/45a17e1c-4406-4803-9e5f-11f13e67824c-kube-api-access-hx9hp\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.716432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-sys\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716431 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-root\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716767 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716437 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cdcbcda4-adab-4393-81e6-e099ecea7587-sys\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716767 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716480 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdcbcda4-adab-4393-81e6-e099ecea7587-metrics-client-ca\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716767 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716739 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-textfile\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716950 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716816 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-accelerators-collector-config\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.716950 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.716864 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a17e1c-4406-4803-9e5f-11f13e67824c-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.717075 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.717054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdcbcda4-adab-4393-81e6-e099ecea7587-metrics-client-ca\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.718635 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.718613 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-tls\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.718749 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.718616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.718749 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.718691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cdcbcda4-adab-4393-81e6-e099ecea7587-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.734065 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.734044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdqmj\" (UniqueName: \"kubernetes.io/projected/cdcbcda4-adab-4393-81e6-e099ecea7587-kube-api-access-fdqmj\") pod \"node-exporter-gjf2w\" (UID: \"cdcbcda4-adab-4393-81e6-e099ecea7587\") " pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.734584 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.734567 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx9hp\" (UniqueName: \"kubernetes.io/projected/45a17e1c-4406-4803-9e5f-11f13e67824c-kube-api-access-hx9hp\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:18.898990 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:18.898960 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gjf2w" Jul 15 22:17:18.909234 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:18.909201 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdcbcda4_adab_4393_81e6_e099ecea7587.slice/crio-66593697a589f6d5d50fcfcc5891b2ac952e176b8c250b4fc1a8b0ce86d7b00e WatchSource:0}: Error finding container 66593697a589f6d5d50fcfcc5891b2ac952e176b8c250b4fc1a8b0ce86d7b00e: Status 404 returned error can't find the container with id 66593697a589f6d5d50fcfcc5891b2ac952e176b8c250b4fc1a8b0ce86d7b00e Jul 15 22:17:19.220097 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.220014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:19.220238 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:19.220178 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 15 22:17:19.220278 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:19.220252 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls podName:45a17e1c-4406-4803-9e5f-11f13e67824c nodeName:}" failed. No retries permitted until 2026-07-15 22:17:20.22023702 +0000 UTC m=+55.390894434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-qhfm5" (UID: "45a17e1c-4406-4803-9e5f-11f13e67824c") : secret "openshift-state-metrics-tls" not found Jul 15 22:17:19.597824 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.597727 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gjf2w" event={"ID":"cdcbcda4-adab-4393-81e6-e099ecea7587","Type":"ContainerStarted","Data":"66593697a589f6d5d50fcfcc5891b2ac952e176b8c250b4fc1a8b0ce86d7b00e"} Jul 15 22:17:19.753978 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.753944 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:17:19.757969 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.757946 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.760931 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.760909 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 15 22:17:19.761048 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.760943 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 15 22:17:19.761558 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.761444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 15 22:17:19.761558 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.761464 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 15 22:17:19.761558 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.761463 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 15 22:17:19.763047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.761462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 15 22:17:19.763047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.761472 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-r7h2j\"" Jul 15 22:17:19.763047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.761802 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 15 22:17:19.763047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.761853 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 15 22:17:19.763047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.761855 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 15 22:17:19.774899 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.774878 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:17:19.824519 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-config-volume\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824695 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824695 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824695 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824695 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824695 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e719288d-75d9-463d-9f54-e9e4d60d9100-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824912 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824912 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824912 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824785 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824912 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824810 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4j87\" (UniqueName: \"kubernetes.io/projected/e719288d-75d9-463d-9f54-e9e4d60d9100-kube-api-access-b4j87\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.824912 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-web-config\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.825111 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.824912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.825111 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.825026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e719288d-75d9-463d-9f54-e9e4d60d9100-config-out\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.925994 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.925972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e719288d-75d9-463d-9f54-e9e4d60d9100-config-out\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926082 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-config-volume\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926082 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926184 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926184 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926184 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926184 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e719288d-75d9-463d-9f54-e9e4d60d9100-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926401 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926401 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:19.926206 2564 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 15 22:17:19.926401 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:19.926267 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-main-tls podName:e719288d-75d9-463d-9f54-e9e4d60d9100 nodeName:}" failed. No retries permitted until 2026-07-15 22:17:20.426247868 +0000 UTC m=+55.596905298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e719288d-75d9-463d-9f54-e9e4d60d9100") : secret "alertmanager-main-tls" not found Jul 15 22:17:19.926401 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926349 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926595 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926421 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926595 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4j87\" (UniqueName: \"kubernetes.io/projected/e719288d-75d9-463d-9f54-e9e4d60d9100-kube-api-access-b4j87\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926595 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:19.926496 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-trusted-ca-bundle podName:e719288d-75d9-463d-9f54-e9e4d60d9100 nodeName:}" failed. No retries permitted until 2026-07-15 22:17:20.426471359 +0000 UTC m=+55.597128783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e719288d-75d9-463d-9f54-e9e4d60d9100") : configmap references non-existent config key: ca-bundle.crt Jul 15 22:17:19.926595 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-web-config\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.926793 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.926612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.927043 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.927020 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.929076 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.929034 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e719288d-75d9-463d-9f54-e9e4d60d9100-config-out\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.929251 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.929227 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e719288d-75d9-463d-9f54-e9e4d60d9100-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.929509 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.929486 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.929584 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.929508 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.929584 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.929494 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-config-volume\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.929963 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.929941 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.930504 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.930482 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.930731 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.930714 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-web-config\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.931459 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.931437 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:19.935737 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:19.935717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4j87\" (UniqueName: \"kubernetes.io/projected/e719288d-75d9-463d-9f54-e9e4d60d9100-kube-api-access-b4j87\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:20.229143 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.229072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:20.229262 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:20.229237 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 15 22:17:20.229333 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:20.229320 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls podName:45a17e1c-4406-4803-9e5f-11f13e67824c nodeName:}" failed. No retries permitted until 2026-07-15 22:17:22.229299165 +0000 UTC m=+57.399956593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-qhfm5" (UID: "45a17e1c-4406-4803-9e5f-11f13e67824c") : secret "openshift-state-metrics-tls" not found Jul 15 22:17:20.431753 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.431722 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:20.431901 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.431764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:20.432604 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.432586 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e719288d-75d9-463d-9f54-e9e4d60d9100-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:20.434011 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.433995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e719288d-75d9-463d-9f54-e9e4d60d9100-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e719288d-75d9-463d-9f54-e9e4d60d9100\") " pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:20.602343 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.602243 2564 generic.go:356] "Generic (PLEG): container finished" podID="cdcbcda4-adab-4393-81e6-e099ecea7587" containerID="c83879087ae43f693de7142e69c624420850f2ada5c229b6d7dcad49e74c47a2" exitCode=0 Jul 15 22:17:20.602693 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.602335 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gjf2w" event={"ID":"cdcbcda4-adab-4393-81e6-e099ecea7587","Type":"ContainerDied","Data":"c83879087ae43f693de7142e69c624420850f2ada5c229b6d7dcad49e74c47a2"} Jul 15 22:17:20.669656 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.669633 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 15 22:17:20.815367 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:20.815336 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 15 22:17:20.819204 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:20.819175 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode719288d_75d9_463d_9f54_e9e4d60d9100.slice/crio-3c04223dde6070e128b94ce347376fd0d46e81d274362e6a0085287d8a59e387 WatchSource:0}: Error finding container 3c04223dde6070e128b94ce347376fd0d46e81d274362e6a0085287d8a59e387: Status 404 returned error can't find the container with id 3c04223dde6070e128b94ce347376fd0d46e81d274362e6a0085287d8a59e387 Jul 15 22:17:21.609808 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.609598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gjf2w" event={"ID":"cdcbcda4-adab-4393-81e6-e099ecea7587","Type":"ContainerStarted","Data":"13428608d1adf5e791270e65062d8940410728441394675f2181b025590e1199"} Jul 15 22:17:21.609808 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.609656 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gjf2w" event={"ID":"cdcbcda4-adab-4393-81e6-e099ecea7587","Type":"ContainerStarted","Data":"f1ceaec05ccc41c778a7f1ba069301bc7301125b9f9f254c7cb35a6d63ccc774"} Jul 15 22:17:21.611092 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.611059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e719288d-75d9-463d-9f54-e9e4d60d9100","Type":"ContainerStarted","Data":"3c04223dde6070e128b94ce347376fd0d46e81d274362e6a0085287d8a59e387"} Jul 15 22:17:21.633922 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.633858 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gjf2w" podStartSLOduration=2.586430258 podStartE2EDuration="3.633843974s" totalImagesPullingTime="984.012157ms" totalInitContainerRuntime="63.401559ms" isStatefulPod=true podCreationTimestamp="2026-07-15 22:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:21.631787992 +0000 UTC m=+56.802445440" watchObservedRunningTime="2026-07-15 22:17:21.633843974 +0000 UTC m=+56.804501410" Jul 15 22:17:21.683107 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.683077 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4"] Jul 15 22:17:21.685633 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.685614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.689804 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.689772 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 15 22:17:21.690863 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.690842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 15 22:17:21.691351 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.691334 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 15 22:17:21.691782 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.691764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t4zl7\"" Jul 15 22:17:21.691890 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.691873 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 15 22:17:21.691986 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.691965 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 15 22:17:21.692158 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.692141 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-amd9h0u4n7f9t\"" Jul 15 22:17:21.700678 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.700659 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4"] Jul 15 22:17:21.742583 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.742554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.742791 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.742722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtxwx\" (UniqueName: \"kubernetes.io/projected/b257f16d-31da-424a-a8f2-3d864023c88e-kube-api-access-xtxwx\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.742791 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.742788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-tls\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.742953 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.742831 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-grpc-tls\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.743007 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.742948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.743007 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.742979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.743088 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.743027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.743088 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.743054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b257f16d-31da-424a-a8f2-3d864023c88e-metrics-client-ca\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.844250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.844214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.844250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.844251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.844471 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.844279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.844471 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.844334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b257f16d-31da-424a-a8f2-3d864023c88e-metrics-client-ca\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.844471 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.844377 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.844471 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.844466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtxwx\" (UniqueName: \"kubernetes.io/projected/b257f16d-31da-424a-a8f2-3d864023c88e-kube-api-access-xtxwx\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.844665 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.844496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-tls\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.844665 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.844521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-grpc-tls\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.845378 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.845249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b257f16d-31da-424a-a8f2-3d864023c88e-metrics-client-ca\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.847344 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.847317 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.847456 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.847323 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.847808 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.847783 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.847929 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.847915 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-grpc-tls\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.848054 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.847999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-tls\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.848688 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.848663 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b257f16d-31da-424a-a8f2-3d864023c88e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.854650 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.854633 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtxwx\" (UniqueName: \"kubernetes.io/projected/b257f16d-31da-424a-a8f2-3d864023c88e-kube-api-access-xtxwx\") pod \"thanos-querier-5f65bc8fc9-n8gk4\" (UID: \"b257f16d-31da-424a-a8f2-3d864023c88e\") " pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:21.998179 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:21.998154 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:22.128717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:22.128689 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4"] Jul 15 22:17:22.131966 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:22.131943 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb257f16d_31da_424a_a8f2_3d864023c88e.slice/crio-d8d4263fe51305712148ebd3da54e664611f5363c43672a1e1ba62bdbeb05baf WatchSource:0}: Error finding container d8d4263fe51305712148ebd3da54e664611f5363c43672a1e1ba62bdbeb05baf: Status 404 returned error can't find the container with id d8d4263fe51305712148ebd3da54e664611f5363c43672a1e1ba62bdbeb05baf Jul 15 22:17:22.247742 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:22.247677 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:22.249855 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:22.249838 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/45a17e1c-4406-4803-9e5f-11f13e67824c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qhfm5\" (UID: \"45a17e1c-4406-4803-9e5f-11f13e67824c\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:22.492411 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:22.492377 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" Jul 15 22:17:22.616194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:22.616156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" event={"ID":"b257f16d-31da-424a-a8f2-3d864023c88e","Type":"ContainerStarted","Data":"d8d4263fe51305712148ebd3da54e664611f5363c43672a1e1ba62bdbeb05baf"} Jul 15 22:17:22.618588 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:22.618547 2564 generic.go:356] "Generic (PLEG): container finished" podID="e719288d-75d9-463d-9f54-e9e4d60d9100" containerID="a3633e77853f2a7b225a553fa8ed53700e6dcf86893674e53fbd7a65c385569c" exitCode=0 Jul 15 22:17:22.618714 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:22.618685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e719288d-75d9-463d-9f54-e9e4d60d9100","Type":"ContainerDied","Data":"a3633e77853f2a7b225a553fa8ed53700e6dcf86893674e53fbd7a65c385569c"} Jul 15 22:17:22.620745 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:22.620725 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5"] Jul 15 22:17:22.623173 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:22.623140 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a17e1c_4406_4803_9e5f_11f13e67824c.slice/crio-79ac99901a513b43048a1b4ced28268f7c060cac8c305edf23e9ff8d0c344348 WatchSource:0}: Error finding container 79ac99901a513b43048a1b4ced28268f7c060cac8c305edf23e9ff8d0c344348: Status 404 returned error can't find the container with id 79ac99901a513b43048a1b4ced28268f7c060cac8c305edf23e9ff8d0c344348 Jul 15 22:17:23.502855 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:23.502819 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:23.503021 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:23.502889 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:23.508955 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:23.508715 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:23.625141 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:23.625112 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" event={"ID":"45a17e1c-4406-4803-9e5f-11f13e67824c","Type":"ContainerStarted","Data":"5a6090770826331f14a07f58ad4f59ca0cc2c808a59387bfb7556b18df2eeaab"} Jul 15 22:17:23.625573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:23.625170 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" event={"ID":"45a17e1c-4406-4803-9e5f-11f13e67824c","Type":"ContainerStarted","Data":"e920ce3d1f718252ec7742dcc1bf92ad5c1ea2d58278c442dd062dcf464583f4"} Jul 15 22:17:23.625573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:23.625193 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" event={"ID":"45a17e1c-4406-4803-9e5f-11f13e67824c","Type":"ContainerStarted","Data":"79ac99901a513b43048a1b4ced28268f7c060cac8c305edf23e9ff8d0c344348"} Jul 15 22:17:23.629942 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:23.629920 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:25.503668 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.503640 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmhl7" Jul 15 22:17:25.636963 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.636926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" event={"ID":"45a17e1c-4406-4803-9e5f-11f13e67824c","Type":"ContainerStarted","Data":"7741ac8103a3ab65d817551508102dd2d7a4e3149664efbb5b5c249ec8fca272"} Jul 15 22:17:25.638985 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.638957 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" event={"ID":"b257f16d-31da-424a-a8f2-3d864023c88e","Type":"ContainerStarted","Data":"3ec411c26e0192c8b52cf67780dcb338c518cf776f77c8d060451d65dbc68943"} Jul 15 22:17:25.639144 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.639015 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" event={"ID":"b257f16d-31da-424a-a8f2-3d864023c88e","Type":"ContainerStarted","Data":"bc566b61760507485608a65628fc7e114cf8ede5cddcf9e4666ca5435f23f7e8"} Jul 15 22:17:25.639144 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.639041 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" event={"ID":"b257f16d-31da-424a-a8f2-3d864023c88e","Type":"ContainerStarted","Data":"48c1fd16a840a719e44eff93fee75dea4b6f3271220f5a36cab6a869726be9bb"} Jul 15 22:17:25.641924 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.641905 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e719288d-75d9-463d-9f54-e9e4d60d9100","Type":"ContainerStarted","Data":"25fb683293e9a5a449155ba08df470ed9aa9dc63e3fd1efeae7eb0472dbea608"} Jul 15 22:17:25.642018 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.641953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e719288d-75d9-463d-9f54-e9e4d60d9100","Type":"ContainerStarted","Data":"ad96afa7ec4274ba0c34ee89c8d9b56c0d3f820825aef3c2567872aa34820820"} Jul 15 22:17:25.642018 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.641982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e719288d-75d9-463d-9f54-e9e4d60d9100","Type":"ContainerStarted","Data":"4b833f00c349e8c2de4db3090c7cab31721d474c9fdab5757634be9bff89fb48"} Jul 15 22:17:25.642018 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.642003 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e719288d-75d9-463d-9f54-e9e4d60d9100","Type":"ContainerStarted","Data":"2a57b842356782cad855289e57de96cc7b2ce572d541931c6493243d54d0e7b4"} Jul 15 22:17:25.642117 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.642025 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e719288d-75d9-463d-9f54-e9e4d60d9100","Type":"ContainerStarted","Data":"9b38a4a5df39dece14fc7131245283576244b40e76fe3360aa7017bc61b607a7"} Jul 15 22:17:25.656779 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:25.656735 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qhfm5" podStartSLOduration=5.352852652 podStartE2EDuration="7.656722245s" totalImagesPullingTime="2.303869593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:25.65551272 +0000 UTC m=+60.826170157" watchObservedRunningTime="2026-07-15 22:17:25.656722245 +0000 UTC m=+60.827379681" Jul 15 22:17:26.649371 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:26.649300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" event={"ID":"b257f16d-31da-424a-a8f2-3d864023c88e","Type":"ContainerStarted","Data":"ef66ee341ba26de069e3331efd08196591aeb1cfe7b2b9ad9c6cb3d8496e4336"} Jul 15 22:17:26.649854 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:26.649461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" event={"ID":"b257f16d-31da-424a-a8f2-3d864023c88e","Type":"ContainerStarted","Data":"0c01cfcae2b1a560e7688ee28fa401479426a05cb22df4b3da2045fce2479ced"} Jul 15 22:17:26.649854 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:26.649507 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" event={"ID":"b257f16d-31da-424a-a8f2-3d864023c88e","Type":"ContainerStarted","Data":"f308aba332b0a426661f6c1e557a1aa0dad346997a551ad89f21fd480034a99a"} Jul 15 22:17:26.649854 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:26.649770 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:26.654209 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:26.654158 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e719288d-75d9-463d-9f54-e9e4d60d9100","Type":"ContainerStarted","Data":"70c4e384d8e5feb6d219f3a268f985ed3e9f1b9af0ae705c29f9e6108f188d8b"} Jul 15 22:17:26.675529 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:26.675488 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" podStartSLOduration=2.035834406 podStartE2EDuration="5.675473492s" totalImagesPullingTime="3.639639086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:26.673886394 +0000 UTC m=+61.844543830" watchObservedRunningTime="2026-07-15 22:17:26.675473492 +0000 UTC m=+61.846130927" Jul 15 22:17:26.708755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:26.708710 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.474443038 podStartE2EDuration="7.708691273s" totalImagesPullingTime="4.214778978s" totalInitContainerRuntime="19.469257ms" isStatefulPod=false podCreationTimestamp="2026-07-15 22:17:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:26.705652633 +0000 UTC m=+61.876310069" watchObservedRunningTime="2026-07-15 22:17:26.708691273 +0000 UTC m=+61.879348710" Jul 15 22:17:31.030337 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.030273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:17:31.033469 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.033449 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 22:17:31.043813 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.043796 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 22:17:31.053445 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.053416 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b542\" (UniqueName: \"kubernetes.io/projected/64ee5b66-5658-44f6-af78-803a3f987af6-kube-api-access-2b542\") pod \"network-check-target-jrzdp\" (UID: \"64ee5b66-5658-44f6-af78-803a3f987af6\") " pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:17:31.131735 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.131706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:17:31.131900 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.131747 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:17:31.134650 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.134634 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 22:17:31.135657 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.135643 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 22:17:31.144854 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.144828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62f11e48-e712-4fdc-89ab-22758881823d-original-pull-secret\") pod \"global-pull-secret-syncer-hp4bm\" (UID: \"62f11e48-e712-4fdc-89ab-22758881823d\") " pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:17:31.144959 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.144834 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4469b73c-e23d-408d-be6b-656c08681932-metrics-certs\") pod \"network-metrics-daemon-7rh6n\" (UID: \"4469b73c-e23d-408d-be6b-656c08681932\") " pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:17:31.185370 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.185341 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xvxsv\"" Jul 15 22:17:31.192831 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.192806 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:17:31.194847 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.194831 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rb8hr\"" Jul 15 22:17:31.203058 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.203041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7rh6n" Jul 15 22:17:31.365546 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.365355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jrzdp"] Jul 15 22:17:31.368567 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:31.368542 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ee5b66_5658_44f6_af78_803a3f987af6.slice/crio-5759ceff16407439d585bc4a1da9182de59836eb6bfd3f93db5aaf406a615c0f WatchSource:0}: Error finding container 5759ceff16407439d585bc4a1da9182de59836eb6bfd3f93db5aaf406a615c0f: Status 404 returned error can't find the container with id 5759ceff16407439d585bc4a1da9182de59836eb6bfd3f93db5aaf406a615c0f Jul 15 22:17:31.377710 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.377690 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp4bm" Jul 15 22:17:31.386534 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.386481 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7rh6n"] Jul 15 22:17:31.388716 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:31.388691 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4469b73c_e23d_408d_be6b_656c08681932.slice/crio-a144f502d9f2d09d42563caee4f48a72d7723bdadf893621f8aaea0a0175d659 WatchSource:0}: Error finding container a144f502d9f2d09d42563caee4f48a72d7723bdadf893621f8aaea0a0175d659: Status 404 returned error can't find the container with id a144f502d9f2d09d42563caee4f48a72d7723bdadf893621f8aaea0a0175d659 Jul 15 22:17:31.525877 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.525855 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hp4bm"] Jul 15 22:17:31.528374 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:17:31.528343 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f11e48_e712_4fdc_89ab_22758881823d.slice/crio-fb682958a4754415ed3879c52d0ff925a80552dcb121f588075e6ec46f0dcc3b WatchSource:0}: Error finding container fb682958a4754415ed3879c52d0ff925a80552dcb121f588075e6ec46f0dcc3b: Status 404 returned error can't find the container with id fb682958a4754415ed3879c52d0ff925a80552dcb121f588075e6ec46f0dcc3b Jul 15 22:17:31.673452 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.673409 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hp4bm" event={"ID":"62f11e48-e712-4fdc-89ab-22758881823d","Type":"ContainerStarted","Data":"fb682958a4754415ed3879c52d0ff925a80552dcb121f588075e6ec46f0dcc3b"} Jul 15 22:17:31.674637 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.674604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rh6n" event={"ID":"4469b73c-e23d-408d-be6b-656c08681932","Type":"ContainerStarted","Data":"a144f502d9f2d09d42563caee4f48a72d7723bdadf893621f8aaea0a0175d659"} Jul 15 22:17:31.675610 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:31.675583 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrzdp" event={"ID":"64ee5b66-5658-44f6-af78-803a3f987af6","Type":"ContainerStarted","Data":"5759ceff16407439d585bc4a1da9182de59836eb6bfd3f93db5aaf406a615c0f"} Jul 15 22:17:32.664580 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:32.664547 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f65bc8fc9-n8gk4" Jul 15 22:17:32.682073 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:32.682029 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rh6n" event={"ID":"4469b73c-e23d-408d-be6b-656c08681932","Type":"ContainerStarted","Data":"d0746a2994b174ce2a09287151d108ea9c6748deb4985ee46ef0875eacad27c4"} Jul 15 22:17:32.682226 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:32.682133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7rh6n" event={"ID":"4469b73c-e23d-408d-be6b-656c08681932","Type":"ContainerStarted","Data":"7e61d89bfbb6395db12cdc6380a00ee4bced1623b8a1e1fbec396504b370d9e1"} Jul 15 22:17:32.720924 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:32.720880 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7rh6n" podStartSLOduration=66.734180527 podStartE2EDuration="1m7.720862972s" totalImagesPullingTime="986.682445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:32.720852242 +0000 UTC m=+67.891509679" watchObservedRunningTime="2026-07-15 22:17:32.720862972 +0000 UTC m=+67.891520402" Jul 15 22:17:33.739834 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:33.739795 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb9cfcfc4-7t8t5"] Jul 15 22:17:34.695600 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:34.695572 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jrzdp" event={"ID":"64ee5b66-5658-44f6-af78-803a3f987af6","Type":"ContainerStarted","Data":"68453e0bf96ab86276669e46cb304d5427f3b9528f3b28211a33bb9031a1fd9c"} Jul 15 22:17:34.695712 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:34.695692 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:17:34.712318 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:34.712258 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jrzdp" podStartSLOduration=66.486267732 podStartE2EDuration="1m9.71224089s" totalImagesPullingTime="3.225973158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:34.710721839 +0000 UTC m=+69.881379275" watchObservedRunningTime="2026-07-15 22:17:34.71224089 +0000 UTC m=+69.882898328" Jul 15 22:17:36.706221 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:36.706172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hp4bm" event={"ID":"62f11e48-e712-4fdc-89ab-22758881823d","Type":"ContainerStarted","Data":"cd3db5dc6523f1c20228d0421f83ff4a0a3de9ba34fa4843f58b70eadc78d649"} Jul 15 22:17:36.723971 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:36.723928 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hp4bm" podStartSLOduration=66.697241298 podStartE2EDuration="1m11.723913086s" totalImagesPullingTime="5.026671788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 22:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:17:36.722789664 +0000 UTC m=+71.893447104" watchObservedRunningTime="2026-07-15 22:17:36.723913086 +0000 UTC m=+71.894570521" Jul 15 22:17:58.770892 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:58.770749 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cb9cfcfc4-7t8t5" podUID="ddfacb2d-c653-4246-a50f-7ae3a5be5307" containerName="console" containerID="cri-o://04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94" gracePeriod=15 Jul 15 22:17:59.000299 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.000262 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:59.144701 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.144670 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-oauth-config\") pod \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " Jul 15 22:17:59.144824 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.144713 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-serving-cert\") pod \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " Jul 15 22:17:59.144824 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.144742 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-config\") pod \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " Jul 15 22:17:59.144824 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.144797 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-service-ca\") pod \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " Jul 15 22:17:59.144971 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.144828 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-oauth-serving-cert\") pod \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " Jul 15 22:17:59.144971 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.144857 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrb7g\" (UniqueName: \"kubernetes.io/projected/ddfacb2d-c653-4246-a50f-7ae3a5be5307-kube-api-access-nrb7g\") pod \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " Jul 15 22:17:59.144971 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.144889 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-trusted-ca-bundle\") pod \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\" (UID: \"ddfacb2d-c653-4246-a50f-7ae3a5be5307\") " Jul 15 22:17:59.145249 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.145215 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-config" (OuterVolumeSpecName: "console-config") pod "ddfacb2d-c653-4246-a50f-7ae3a5be5307" (UID: "ddfacb2d-c653-4246-a50f-7ae3a5be5307"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:17:59.145405 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.145236 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ddfacb2d-c653-4246-a50f-7ae3a5be5307" (UID: "ddfacb2d-c653-4246-a50f-7ae3a5be5307"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:17:59.145405 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.145228 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-service-ca" (OuterVolumeSpecName: "service-ca") pod "ddfacb2d-c653-4246-a50f-7ae3a5be5307" (UID: "ddfacb2d-c653-4246-a50f-7ae3a5be5307"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:17:59.145523 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.145451 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ddfacb2d-c653-4246-a50f-7ae3a5be5307" (UID: "ddfacb2d-c653-4246-a50f-7ae3a5be5307"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:17:59.147168 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.147134 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ddfacb2d-c653-4246-a50f-7ae3a5be5307" (UID: "ddfacb2d-c653-4246-a50f-7ae3a5be5307"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:17:59.147253 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.147185 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddfacb2d-c653-4246-a50f-7ae3a5be5307-kube-api-access-nrb7g" (OuterVolumeSpecName: "kube-api-access-nrb7g") pod "ddfacb2d-c653-4246-a50f-7ae3a5be5307" (UID: "ddfacb2d-c653-4246-a50f-7ae3a5be5307"). InnerVolumeSpecName "kube-api-access-nrb7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:17:59.147253 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.147187 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ddfacb2d-c653-4246-a50f-7ae3a5be5307" (UID: "ddfacb2d-c653-4246-a50f-7ae3a5be5307"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:17:59.245646 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.245619 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-oauth-config\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:17:59.245646 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.245645 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-serving-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:17:59.245781 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.245659 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-console-config\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:17:59.245781 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.245671 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-service-ca\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:17:59.245781 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.245682 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-oauth-serving-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:17:59.245781 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.245694 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrb7g\" (UniqueName: \"kubernetes.io/projected/ddfacb2d-c653-4246-a50f-7ae3a5be5307-kube-api-access-nrb7g\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:17:59.245781 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.245706 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddfacb2d-c653-4246-a50f-7ae3a5be5307-trusted-ca-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:17:59.795910 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.795874 2564 generic.go:356] "Generic (PLEG): container finished" podID="ddfacb2d-c653-4246-a50f-7ae3a5be5307" containerID="04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94" exitCode=0 Jul 15 22:17:59.796321 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.795915 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb9cfcfc4-7t8t5" Jul 15 22:17:59.796321 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.795962 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb9cfcfc4-7t8t5" event={"ID":"ddfacb2d-c653-4246-a50f-7ae3a5be5307","Type":"ContainerDied","Data":"04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94"} Jul 15 22:17:59.796321 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.796019 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb9cfcfc4-7t8t5" event={"ID":"ddfacb2d-c653-4246-a50f-7ae3a5be5307","Type":"ContainerDied","Data":"b96c89c056684a14f0011589fa621307787aae86b9c82a5fd417dc288887e336"} Jul 15 22:17:59.796321 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.796041 2564 scope.go:117] "RemoveContainer" containerID="04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94" Jul 15 22:17:59.804564 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.804544 2564 scope.go:117] "RemoveContainer" containerID="04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94" Jul 15 22:17:59.804816 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:17:59.804796 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94\": container with ID starting with 04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94 not found: ID does not exist" containerID="04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94" Jul 15 22:17:59.804869 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.804824 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94"} err="failed to get container status \"04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94\": rpc error: code = NotFound desc = could not find container \"04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94\": container with ID starting with 04a6ed4e5b354e573bceebf992b1262fec6a88d535203f22e3b9e465aa035a94 not found: ID does not exist" Jul 15 22:17:59.814959 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.813619 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb9cfcfc4-7t8t5"] Jul 15 22:17:59.817077 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:17:59.817055 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb9cfcfc4-7t8t5"] Jul 15 22:18:01.370315 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:01.370265 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddfacb2d-c653-4246-a50f-7ae3a5be5307" path="/var/lib/kubelet/pods/ddfacb2d-c653-4246-a50f-7ae3a5be5307/volumes" Jul 15 22:18:05.701629 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:05.701595 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jrzdp" Jul 15 22:18:42.998125 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:42.998087 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-966d99596-2wxwl"] Jul 15 22:18:42.998756 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:42.998550 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddfacb2d-c653-4246-a50f-7ae3a5be5307" containerName="console" Jul 15 22:18:42.998756 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:42.998569 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddfacb2d-c653-4246-a50f-7ae3a5be5307" containerName="console" Jul 15 22:18:42.998756 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:42.998631 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddfacb2d-c653-4246-a50f-7ae3a5be5307" containerName="console" Jul 15 22:18:43.001494 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.001472 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.004323 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.004279 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 22:18:43.004524 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.004498 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jlmmq\"" Jul 15 22:18:43.004634 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.004331 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 22:18:43.004634 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.004429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 22:18:43.004741 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.004309 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 22:18:43.005379 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.004951 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 22:18:43.009822 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.009801 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 22:18:43.013259 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.013240 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-966d99596-2wxwl"] Jul 15 22:18:43.036080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.036049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rth8q\" (UniqueName: \"kubernetes.io/projected/ed289551-2cc6-4a9a-836e-132441e0825d-kube-api-access-rth8q\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.036080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.036078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.036250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.036105 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-federate-client-tls\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.036250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.036170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-serving-certs-ca-bundle\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.036250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.036229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.036250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.036248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-metrics-client-ca\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.036433 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.036265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-secret-telemeter-client\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.036433 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.036279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-telemeter-client-tls\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.136993 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.136962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rth8q\" (UniqueName: \"kubernetes.io/projected/ed289551-2cc6-4a9a-836e-132441e0825d-kube-api-access-rth8q\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.137157 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.136998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.137157 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.137122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-federate-client-tls\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.137331 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.137183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-serving-certs-ca-bundle\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.137331 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.137221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.137331 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.137242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-metrics-client-ca\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.137331 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.137259 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-secret-telemeter-client\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.137331 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.137300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-telemeter-client-tls\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.138047 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.138023 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-serving-certs-ca-bundle\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.138152 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.138062 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-metrics-client-ca\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.138214 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.138192 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed289551-2cc6-4a9a-836e-132441e0825d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.139630 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.139603 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-federate-client-tls\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.139753 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.139733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-telemeter-client-tls\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.139819 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.139759 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.140057 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.140038 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ed289551-2cc6-4a9a-836e-132441e0825d-secret-telemeter-client\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.145185 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.145167 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rth8q\" (UniqueName: \"kubernetes.io/projected/ed289551-2cc6-4a9a-836e-132441e0825d-kube-api-access-rth8q\") pod \"telemeter-client-966d99596-2wxwl\" (UID: \"ed289551-2cc6-4a9a-836e-132441e0825d\") " pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.312452 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.312383 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" Jul 15 22:18:43.445447 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.445424 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-966d99596-2wxwl"] Jul 15 22:18:43.447523 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:18:43.447487 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded289551_2cc6_4a9a_836e_132441e0825d.slice/crio-591e16144fe82ce229213b583bac9de1f82bf5accc0366506a4a86217f783038 WatchSource:0}: Error finding container 591e16144fe82ce229213b583bac9de1f82bf5accc0366506a4a86217f783038: Status 404 returned error can't find the container with id 591e16144fe82ce229213b583bac9de1f82bf5accc0366506a4a86217f783038 Jul 15 22:18:43.951730 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:43.951697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" event={"ID":"ed289551-2cc6-4a9a-836e-132441e0825d","Type":"ContainerStarted","Data":"591e16144fe82ce229213b583bac9de1f82bf5accc0366506a4a86217f783038"} Jul 15 22:18:45.961485 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:45.961406 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" event={"ID":"ed289551-2cc6-4a9a-836e-132441e0825d","Type":"ContainerStarted","Data":"9d44a17c2c810220fbdaf99e27bb1faa3e1098bb3a3a03e886a5d4c01b19396f"} Jul 15 22:18:45.961485 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:45.961467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" event={"ID":"ed289551-2cc6-4a9a-836e-132441e0825d","Type":"ContainerStarted","Data":"8dcdfa3fff1c8d339b27f593f4d74bdc48dbc375ba4c1e7cfb9d394880760412"} Jul 15 22:18:45.961485 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:45.961486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" event={"ID":"ed289551-2cc6-4a9a-836e-132441e0825d","Type":"ContainerStarted","Data":"1626f2f362add48b91e7fc0d9d67447e3a4a1639f1c2218f879870bc1f83ea04"} Jul 15 22:18:45.993431 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:45.993371 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-966d99596-2wxwl" podStartSLOduration=1.809477749 podStartE2EDuration="3.993356606s" totalImagesPullingTime="2.183878857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:18:45.992399631 +0000 UTC m=+141.163057070" watchObservedRunningTime="2026-07-15 22:18:45.993356606 +0000 UTC m=+141.164014042" Jul 15 22:18:46.742660 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.742631 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78f855f477-5frs5"] Jul 15 22:18:46.744717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.744700 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.747833 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.747814 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 22:18:46.747934 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.747838 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 22:18:46.747934 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.747838 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 22:18:46.749320 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.749302 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2b7m5\"" Jul 15 22:18:46.749426 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.749302 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 22:18:46.749426 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.749305 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 22:18:46.749426 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.749389 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 22:18:46.749750 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.749737 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 22:18:46.754337 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.754320 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 22:18:46.758666 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.758646 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f855f477-5frs5"] Jul 15 22:18:46.863200 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.863171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-serving-cert\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.863347 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.863213 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-config\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.863347 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.863239 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-oauth-config\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.863347 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.863314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-service-ca\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.863482 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.863361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4zfq\" (UniqueName: \"kubernetes.io/projected/1f92a55f-2a12-4065-ae83-f5cca0753ff1-kube-api-access-q4zfq\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.863482 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.863380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-oauth-serving-cert\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.863482 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.863400 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-trusted-ca-bundle\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.964082 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.964064 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-config\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.964465 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.964089 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-oauth-config\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.964465 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.964109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-service-ca\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.964465 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.964135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4zfq\" (UniqueName: \"kubernetes.io/projected/1f92a55f-2a12-4065-ae83-f5cca0753ff1-kube-api-access-q4zfq\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.964465 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.964157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-oauth-serving-cert\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.964465 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.964186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-trusted-ca-bundle\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.964465 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.964223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-serving-cert\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.965050 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.965029 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-trusted-ca-bundle\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.965127 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.965049 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-config\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.965127 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.965114 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-service-ca\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.965244 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.965219 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-oauth-serving-cert\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.966735 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.966717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-serving-cert\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.966788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.966729 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-oauth-config\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:46.973873 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:46.973852 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4zfq\" (UniqueName: \"kubernetes.io/projected/1f92a55f-2a12-4065-ae83-f5cca0753ff1-kube-api-access-q4zfq\") pod \"console-78f855f477-5frs5\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:47.054930 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:47.054867 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:47.203695 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:47.203670 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f855f477-5frs5"] Jul 15 22:18:47.205342 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:18:47.205315 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f92a55f_2a12_4065_ae83_f5cca0753ff1.slice/crio-1f3ee34dd15a55d2804e88192b65116c317b4ad969087d65e4e1dee65d07fc7b WatchSource:0}: Error finding container 1f3ee34dd15a55d2804e88192b65116c317b4ad969087d65e4e1dee65d07fc7b: Status 404 returned error can't find the container with id 1f3ee34dd15a55d2804e88192b65116c317b4ad969087d65e4e1dee65d07fc7b Jul 15 22:18:47.970958 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:47.970922 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f855f477-5frs5" event={"ID":"1f92a55f-2a12-4065-ae83-f5cca0753ff1","Type":"ContainerStarted","Data":"5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f"} Jul 15 22:18:47.971391 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:47.970978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f855f477-5frs5" event={"ID":"1f92a55f-2a12-4065-ae83-f5cca0753ff1","Type":"ContainerStarted","Data":"1f3ee34dd15a55d2804e88192b65116c317b4ad969087d65e4e1dee65d07fc7b"} Jul 15 22:18:47.990679 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:47.990628 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78f855f477-5frs5" podStartSLOduration=1.990611601 podStartE2EDuration="1.990611601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:18:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:18:47.988691864 +0000 UTC m=+143.159349300" watchObservedRunningTime="2026-07-15 22:18:47.990611601 +0000 UTC m=+143.161269038" Jul 15 22:18:57.055607 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:57.055581 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:57.056048 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:57.055849 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:57.060227 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:57.060209 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:58.008823 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.008794 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:18:58.172820 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.172795 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5688bdcbdb-fpntc"] Jul 15 22:18:58.175631 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.175615 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.186661 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.186641 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5688bdcbdb-fpntc"] Jul 15 22:18:58.243186 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.243158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd5zz\" (UniqueName: \"kubernetes.io/projected/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-kube-api-access-pd5zz\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.243186 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.243189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-oauth-config\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.243422 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.243210 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-oauth-serving-cert\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.243422 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.243226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-service-ca\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.243422 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.243339 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-trusted-ca-bundle\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.243422 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.243391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-serving-cert\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.243422 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.243419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-config\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.344767 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.344703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd5zz\" (UniqueName: \"kubernetes.io/projected/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-kube-api-access-pd5zz\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.344767 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.344736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-oauth-config\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.344767 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.344761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-oauth-serving-cert\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.344937 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.344777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-service-ca\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.344937 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.344825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-trusted-ca-bundle\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.344937 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.344863 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-serving-cert\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.344937 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.344884 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-config\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.345594 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.345566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-service-ca\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.345692 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.345642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-oauth-serving-cert\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.345841 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.345808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-config\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.345970 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.345949 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-trusted-ca-bundle\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.347361 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.347342 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-oauth-config\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.347443 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.347418 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-serving-cert\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.352937 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.352908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd5zz\" (UniqueName: \"kubernetes.io/projected/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-kube-api-access-pd5zz\") pod \"console-5688bdcbdb-fpntc\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.484036 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.484010 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:18:58.623358 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:58.623328 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5688bdcbdb-fpntc"] Jul 15 22:18:58.625754 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:18:58.625727 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c5ccdc_b82b_4138_ad2e_9966e6d29396.slice/crio-dcbcc84a18a3871d67a18e542c80850909d2355915f552faa971afb629adfe83 WatchSource:0}: Error finding container dcbcc84a18a3871d67a18e542c80850909d2355915f552faa971afb629adfe83: Status 404 returned error can't find the container with id dcbcc84a18a3871d67a18e542c80850909d2355915f552faa971afb629adfe83 Jul 15 22:18:59.009658 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:59.009621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5688bdcbdb-fpntc" event={"ID":"a1c5ccdc-b82b-4138-ad2e-9966e6d29396","Type":"ContainerStarted","Data":"ac4de4f0b419530f203164c0140dcf5b6728f053fb92d021d5c7518b306122be"} Jul 15 22:18:59.009851 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:59.009674 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5688bdcbdb-fpntc" event={"ID":"a1c5ccdc-b82b-4138-ad2e-9966e6d29396","Type":"ContainerStarted","Data":"dcbcc84a18a3871d67a18e542c80850909d2355915f552faa971afb629adfe83"} Jul 15 22:18:59.029065 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:18:59.029015 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5688bdcbdb-fpntc" podStartSLOduration=1.029000132 podStartE2EDuration="1.029000132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:18:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:18:59.027041908 +0000 UTC m=+154.197699343" watchObservedRunningTime="2026-07-15 22:18:59.029000132 +0000 UTC m=+154.199657569" Jul 15 22:19:08.484378 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:08.484341 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:19:08.484800 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:08.484401 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:19:08.489208 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:08.489187 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:19:09.049038 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:09.049003 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:19:09.099695 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:09.099661 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f855f477-5frs5"] Jul 15 22:19:34.123447 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.123341 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78f855f477-5frs5" podUID="1f92a55f-2a12-4065-ae83-f5cca0753ff1" containerName="console" containerID="cri-o://5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f" gracePeriod=15 Jul 15 22:19:34.358667 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.358644 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:19:34.413457 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413435 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-config\") pod \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " Jul 15 22:19:34.413584 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413466 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-oauth-config\") pod \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " Jul 15 22:19:34.413584 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413504 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4zfq\" (UniqueName: \"kubernetes.io/projected/1f92a55f-2a12-4065-ae83-f5cca0753ff1-kube-api-access-q4zfq\") pod \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " Jul 15 22:19:34.413669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413608 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-trusted-ca-bundle\") pod \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " Jul 15 22:19:34.413669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413657 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-service-ca\") pod \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " Jul 15 22:19:34.413748 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413716 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-serving-cert\") pod \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " Jul 15 22:19:34.413793 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413768 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-config" (OuterVolumeSpecName: "console-config") pod "1f92a55f-2a12-4065-ae83-f5cca0753ff1" (UID: "1f92a55f-2a12-4065-ae83-f5cca0753ff1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:19:34.413954 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413936 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-config\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:19:34.414040 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.413995 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f92a55f-2a12-4065-ae83-f5cca0753ff1" (UID: "1f92a55f-2a12-4065-ae83-f5cca0753ff1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:19:34.414040 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.414026 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f92a55f-2a12-4065-ae83-f5cca0753ff1" (UID: "1f92a55f-2a12-4065-ae83-f5cca0753ff1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:19:34.415588 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.415561 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f92a55f-2a12-4065-ae83-f5cca0753ff1-kube-api-access-q4zfq" (OuterVolumeSpecName: "kube-api-access-q4zfq") pod "1f92a55f-2a12-4065-ae83-f5cca0753ff1" (UID: "1f92a55f-2a12-4065-ae83-f5cca0753ff1"). InnerVolumeSpecName "kube-api-access-q4zfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:19:34.415697 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.415634 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f92a55f-2a12-4065-ae83-f5cca0753ff1" (UID: "1f92a55f-2a12-4065-ae83-f5cca0753ff1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:19:34.415743 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.415687 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f92a55f-2a12-4065-ae83-f5cca0753ff1" (UID: "1f92a55f-2a12-4065-ae83-f5cca0753ff1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:19:34.515120 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.515090 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-oauth-serving-cert\") pod \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\" (UID: \"1f92a55f-2a12-4065-ae83-f5cca0753ff1\") " Jul 15 22:19:34.515267 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.515239 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4zfq\" (UniqueName: \"kubernetes.io/projected/1f92a55f-2a12-4065-ae83-f5cca0753ff1-kube-api-access-q4zfq\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:19:34.515267 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.515250 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-trusted-ca-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:19:34.515267 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.515261 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-service-ca\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:19:34.515267 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.515269 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-serving-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:19:34.515509 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.515278 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f92a55f-2a12-4065-ae83-f5cca0753ff1-console-oauth-config\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:19:34.515559 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.515511 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f92a55f-2a12-4065-ae83-f5cca0753ff1" (UID: "1f92a55f-2a12-4065-ae83-f5cca0753ff1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:19:34.616087 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:34.616055 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f92a55f-2a12-4065-ae83-f5cca0753ff1-oauth-serving-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:19:35.144384 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.144347 2564 generic.go:356] "Generic (PLEG): container finished" podID="1f92a55f-2a12-4065-ae83-f5cca0753ff1" containerID="5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f" exitCode=0 Jul 15 22:19:35.144842 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.144403 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f855f477-5frs5" Jul 15 22:19:35.144842 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.144433 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f855f477-5frs5" event={"ID":"1f92a55f-2a12-4065-ae83-f5cca0753ff1","Type":"ContainerDied","Data":"5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f"} Jul 15 22:19:35.144842 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.144484 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f855f477-5frs5" event={"ID":"1f92a55f-2a12-4065-ae83-f5cca0753ff1","Type":"ContainerDied","Data":"1f3ee34dd15a55d2804e88192b65116c317b4ad969087d65e4e1dee65d07fc7b"} Jul 15 22:19:35.144842 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.144508 2564 scope.go:117] "RemoveContainer" containerID="5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f" Jul 15 22:19:35.153061 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.153040 2564 scope.go:117] "RemoveContainer" containerID="5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f" Jul 15 22:19:35.153384 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:19:35.153272 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f\": container with ID starting with 5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f not found: ID does not exist" containerID="5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f" Jul 15 22:19:35.153451 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.153395 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f"} err="failed to get container status \"5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f\": rpc error: code = NotFound desc = could not find container \"5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f\": container with ID starting with 5b81fd99bc3a9039f32c14759551f3e7b1db4fe444cbcfa9c15aedda6bea561f not found: ID does not exist" Jul 15 22:19:35.165137 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.165116 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f855f477-5frs5"] Jul 15 22:19:35.172393 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.172374 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78f855f477-5frs5"] Jul 15 22:19:35.370459 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:19:35.370432 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f92a55f-2a12-4065-ae83-f5cca0753ff1" path="/var/lib/kubelet/pods/1f92a55f-2a12-4065-ae83-f5cca0753ff1/volumes" Jul 15 22:20:07.642393 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.642359 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9"] Jul 15 22:20:07.642777 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.642646 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f92a55f-2a12-4065-ae83-f5cca0753ff1" containerName="console" Jul 15 22:20:07.642777 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.642657 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f92a55f-2a12-4065-ae83-f5cca0753ff1" containerName="console" Jul 15 22:20:07.642777 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.642700 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f92a55f-2a12-4065-ae83-f5cca0753ff1" containerName="console" Jul 15 22:20:07.644792 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.644776 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.648439 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.648421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q5h95\"" Jul 15 22:20:07.648667 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.648656 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 22:20:07.649804 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.649787 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 22:20:07.661846 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.661815 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9"] Jul 15 22:20:07.770176 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.770152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.770314 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.770184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8g8x\" (UniqueName: \"kubernetes.io/projected/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-kube-api-access-r8g8x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.770314 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.770279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.871421 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.871395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.871539 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.871449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.871539 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.871483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8g8x\" (UniqueName: \"kubernetes.io/projected/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-kube-api-access-r8g8x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.871748 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.871727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.871818 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.871800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.887232 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.887215 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8g8x\" (UniqueName: \"kubernetes.io/projected/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-kube-api-access-r8g8x\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:07.953757 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:07.953706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:08.082498 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:08.082472 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9"] Jul 15 22:20:08.084010 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:20:08.083984 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12997dc8_d2fd_4835_84a9_faf8e92e1ee0.slice/crio-34c8fa270ce531878bfd31b97ea6cb91e1251a6f24d27ebb6ce005f868d03db3 WatchSource:0}: Error finding container 34c8fa270ce531878bfd31b97ea6cb91e1251a6f24d27ebb6ce005f868d03db3: Status 404 returned error can't find the container with id 34c8fa270ce531878bfd31b97ea6cb91e1251a6f24d27ebb6ce005f868d03db3 Jul 15 22:20:08.262169 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:08.262093 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" event={"ID":"12997dc8-d2fd-4835-84a9-faf8e92e1ee0","Type":"ContainerStarted","Data":"34c8fa270ce531878bfd31b97ea6cb91e1251a6f24d27ebb6ce005f868d03db3"} Jul 15 22:20:16.294552 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:16.294522 2564 generic.go:356] "Generic (PLEG): container finished" podID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerID="8585fb365bd43d51176a08c2530321109a554149f8c5ad19490474ea8c03c3a3" exitCode=0 Jul 15 22:20:16.294908 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:16.294597 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" event={"ID":"12997dc8-d2fd-4835-84a9-faf8e92e1ee0","Type":"ContainerDied","Data":"8585fb365bd43d51176a08c2530321109a554149f8c5ad19490474ea8c03c3a3"} Jul 15 22:20:19.308426 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:19.308390 2564 generic.go:356] "Generic (PLEG): container finished" podID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerID="aeaedd84786f9a2feab2ed38a19615fccab7355e493b788d4245f42b947eea0e" exitCode=0 Jul 15 22:20:19.308785 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:19.308473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" event={"ID":"12997dc8-d2fd-4835-84a9-faf8e92e1ee0","Type":"ContainerDied","Data":"aeaedd84786f9a2feab2ed38a19615fccab7355e493b788d4245f42b947eea0e"} Jul 15 22:20:28.346215 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:28.346129 2564 generic.go:356] "Generic (PLEG): container finished" podID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerID="fb1009c479ce90f4a9ba9e3ffdd53bca4655e7a98d8cf3ca4a15359d13c23732" exitCode=0 Jul 15 22:20:28.346598 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:28.346212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" event={"ID":"12997dc8-d2fd-4835-84a9-faf8e92e1ee0","Type":"ContainerDied","Data":"fb1009c479ce90f4a9ba9e3ffdd53bca4655e7a98d8cf3ca4a15359d13c23732"} Jul 15 22:20:29.510669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.510630 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:29.639199 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.639166 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8g8x\" (UniqueName: \"kubernetes.io/projected/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-kube-api-access-r8g8x\") pod \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " Jul 15 22:20:29.639396 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.639211 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-bundle\") pod \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " Jul 15 22:20:29.639396 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.639239 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-util\") pod \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\" (UID: \"12997dc8-d2fd-4835-84a9-faf8e92e1ee0\") " Jul 15 22:20:29.639875 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.639844 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-bundle" (OuterVolumeSpecName: "bundle") pod "12997dc8-d2fd-4835-84a9-faf8e92e1ee0" (UID: "12997dc8-d2fd-4835-84a9-faf8e92e1ee0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:20:29.641328 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.641308 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-kube-api-access-r8g8x" (OuterVolumeSpecName: "kube-api-access-r8g8x") pod "12997dc8-d2fd-4835-84a9-faf8e92e1ee0" (UID: "12997dc8-d2fd-4835-84a9-faf8e92e1ee0"). InnerVolumeSpecName "kube-api-access-r8g8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:20:29.643166 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.643144 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-util" (OuterVolumeSpecName: "util") pod "12997dc8-d2fd-4835-84a9-faf8e92e1ee0" (UID: "12997dc8-d2fd-4835-84a9-faf8e92e1ee0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:20:29.740680 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.740646 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8g8x\" (UniqueName: \"kubernetes.io/projected/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-kube-api-access-r8g8x\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:20:29.740680 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.740674 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:20:29.740680 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:29.740683 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12997dc8-d2fd-4835-84a9-faf8e92e1ee0-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:20:30.355477 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:30.355445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" event={"ID":"12997dc8-d2fd-4835-84a9-faf8e92e1ee0","Type":"ContainerDied","Data":"34c8fa270ce531878bfd31b97ea6cb91e1251a6f24d27ebb6ce005f868d03db3"} Jul 15 22:20:30.355641 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:30.355490 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34c8fa270ce531878bfd31b97ea6cb91e1251a6f24d27ebb6ce005f868d03db3" Jul 15 22:20:30.355641 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:30.355459 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405dsn9" Jul 15 22:20:36.242060 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.242029 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr"] Jul 15 22:20:36.242513 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.242308 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerName="extract" Jul 15 22:20:36.242513 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.242318 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerName="extract" Jul 15 22:20:36.242513 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.242342 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerName="util" Jul 15 22:20:36.242513 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.242348 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerName="util" Jul 15 22:20:36.242513 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.242354 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerName="pull" Jul 15 22:20:36.242513 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.242359 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerName="pull" Jul 15 22:20:36.242513 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.242402 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="12997dc8-d2fd-4835-84a9-faf8e92e1ee0" containerName="extract" Jul 15 22:20:36.245404 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.245387 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" Jul 15 22:20:36.249059 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.249026 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:20:36.249194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.249038 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-spw72\"" Jul 15 22:20:36.249194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.249176 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 22:20:36.261681 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.261643 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr"] Jul 15 22:20:36.287129 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.287106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc53efa-b9f5-449e-a022-0ff68fcfc807-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cx2kr\" (UID: \"6cc53efa-b9f5-449e-a022-0ff68fcfc807\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" Jul 15 22:20:36.287216 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.287156 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7pfj\" (UniqueName: \"kubernetes.io/projected/6cc53efa-b9f5-449e-a022-0ff68fcfc807-kube-api-access-w7pfj\") pod \"cert-manager-operator-controller-manager-55c444bf86-cx2kr\" (UID: \"6cc53efa-b9f5-449e-a022-0ff68fcfc807\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" Jul 15 22:20:36.388050 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.388021 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc53efa-b9f5-449e-a022-0ff68fcfc807-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cx2kr\" (UID: \"6cc53efa-b9f5-449e-a022-0ff68fcfc807\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" Jul 15 22:20:36.388166 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.388087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7pfj\" (UniqueName: \"kubernetes.io/projected/6cc53efa-b9f5-449e-a022-0ff68fcfc807-kube-api-access-w7pfj\") pod \"cert-manager-operator-controller-manager-55c444bf86-cx2kr\" (UID: \"6cc53efa-b9f5-449e-a022-0ff68fcfc807\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" Jul 15 22:20:36.388489 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.388465 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cc53efa-b9f5-449e-a022-0ff68fcfc807-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cx2kr\" (UID: \"6cc53efa-b9f5-449e-a022-0ff68fcfc807\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" Jul 15 22:20:36.397280 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.397255 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7pfj\" (UniqueName: \"kubernetes.io/projected/6cc53efa-b9f5-449e-a022-0ff68fcfc807-kube-api-access-w7pfj\") pod \"cert-manager-operator-controller-manager-55c444bf86-cx2kr\" (UID: \"6cc53efa-b9f5-449e-a022-0ff68fcfc807\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" Jul 15 22:20:36.553924 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.553862 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" Jul 15 22:20:36.688758 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:36.688724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr"] Jul 15 22:20:36.691957 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:20:36.691920 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc53efa_b9f5_449e_a022_0ff68fcfc807.slice/crio-1eb2cbeda36f5457fd018c572caa30713f8ef6f5ed035f0bbeea0bb907d49e74 WatchSource:0}: Error finding container 1eb2cbeda36f5457fd018c572caa30713f8ef6f5ed035f0bbeea0bb907d49e74: Status 404 returned error can't find the container with id 1eb2cbeda36f5457fd018c572caa30713f8ef6f5ed035f0bbeea0bb907d49e74 Jul 15 22:20:37.381994 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:37.381961 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" event={"ID":"6cc53efa-b9f5-449e-a022-0ff68fcfc807","Type":"ContainerStarted","Data":"1eb2cbeda36f5457fd018c572caa30713f8ef6f5ed035f0bbeea0bb907d49e74"} Jul 15 22:20:38.388019 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:38.387952 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" event={"ID":"6cc53efa-b9f5-449e-a022-0ff68fcfc807","Type":"ContainerStarted","Data":"108b8031d0f15bdb0de8dcdb962bcc653bcf8496d3af72a8f6f0fe142599aa82"} Jul 15 22:20:41.027150 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.027098 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cx2kr" podStartSLOduration=3.429477553 podStartE2EDuration="5.027082477s" totalImagesPullingTime="1.597604924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:20:38.450608448 +0000 UTC m=+253.621265886" watchObservedRunningTime="2026-07-15 22:20:41.027082477 +0000 UTC m=+256.197739916" Jul 15 22:20:41.028003 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.027986 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8"] Jul 15 22:20:41.030280 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.030262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.051480 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.051459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 22:20:41.056709 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.056689 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q5h95\"" Jul 15 22:20:41.057639 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.057622 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 22:20:41.101668 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.101640 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8"] Jul 15 22:20:41.126341 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.126311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.126565 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.126363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dh9v\" (UniqueName: \"kubernetes.io/projected/1752e9a5-2883-4d44-acc4-def887077d41-kube-api-access-4dh9v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.126724 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.126704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.228173 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.228138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.228173 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.228176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dh9v\" (UniqueName: \"kubernetes.io/projected/1752e9a5-2883-4d44-acc4-def887077d41-kube-api-access-4dh9v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.228394 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.228204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.228535 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.228520 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.228570 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.228556 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.247745 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.247718 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dh9v\" (UniqueName: \"kubernetes.io/projected/1752e9a5-2883-4d44-acc4-def887077d41-kube-api-access-4dh9v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.340971 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.340890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:41.497018 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:41.496988 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8"] Jul 15 22:20:41.501639 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:20:41.501608 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1752e9a5_2883_4d44_acc4_def887077d41.slice/crio-8a7375e73320521bba62086cc65a482c16aadfab5b5d6f6e374acd97898917f3 WatchSource:0}: Error finding container 8a7375e73320521bba62086cc65a482c16aadfab5b5d6f6e374acd97898917f3: Status 404 returned error can't find the container with id 8a7375e73320521bba62086cc65a482c16aadfab5b5d6f6e374acd97898917f3 Jul 15 22:20:42.408706 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:42.408669 2564 generic.go:356] "Generic (PLEG): container finished" podID="1752e9a5-2883-4d44-acc4-def887077d41" containerID="71ff2f438d5a66856428e7fc5253234cbfeff024bd9b0533ff5176f17341c75b" exitCode=0 Jul 15 22:20:42.409048 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:42.408747 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" event={"ID":"1752e9a5-2883-4d44-acc4-def887077d41","Type":"ContainerDied","Data":"71ff2f438d5a66856428e7fc5253234cbfeff024bd9b0533ff5176f17341c75b"} Jul 15 22:20:42.409048 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:42.408798 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" event={"ID":"1752e9a5-2883-4d44-acc4-def887077d41","Type":"ContainerStarted","Data":"8a7375e73320521bba62086cc65a482c16aadfab5b5d6f6e374acd97898917f3"} Jul 15 22:20:43.705966 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.705926 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w"] Jul 15 22:20:43.711025 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.711003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" Jul 15 22:20:43.717854 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.717828 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6wdwh\"" Jul 15 22:20:43.718380 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.718357 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 22:20:43.719076 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.719028 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 22:20:43.733485 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.733459 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w"] Jul 15 22:20:43.749601 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.749569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg4f7\" (UniqueName: \"kubernetes.io/projected/6b9b2472-0d6f-4d95-acbe-8ea3ab45f811-kube-api-access-jg4f7\") pod \"cert-manager-cainjector-559cdd8c87-wmw8w\" (UID: \"6b9b2472-0d6f-4d95-acbe-8ea3ab45f811\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" Jul 15 22:20:43.749743 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.749690 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b9b2472-0d6f-4d95-acbe-8ea3ab45f811-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wmw8w\" (UID: \"6b9b2472-0d6f-4d95-acbe-8ea3ab45f811\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" Jul 15 22:20:43.850908 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.850872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b9b2472-0d6f-4d95-acbe-8ea3ab45f811-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wmw8w\" (UID: \"6b9b2472-0d6f-4d95-acbe-8ea3ab45f811\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" Jul 15 22:20:43.851077 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.850937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg4f7\" (UniqueName: \"kubernetes.io/projected/6b9b2472-0d6f-4d95-acbe-8ea3ab45f811-kube-api-access-jg4f7\") pod \"cert-manager-cainjector-559cdd8c87-wmw8w\" (UID: \"6b9b2472-0d6f-4d95-acbe-8ea3ab45f811\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" Jul 15 22:20:43.871088 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.871054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg4f7\" (UniqueName: \"kubernetes.io/projected/6b9b2472-0d6f-4d95-acbe-8ea3ab45f811-kube-api-access-jg4f7\") pod \"cert-manager-cainjector-559cdd8c87-wmw8w\" (UID: \"6b9b2472-0d6f-4d95-acbe-8ea3ab45f811\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" Jul 15 22:20:43.875342 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:43.875316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b9b2472-0d6f-4d95-acbe-8ea3ab45f811-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wmw8w\" (UID: \"6b9b2472-0d6f-4d95-acbe-8ea3ab45f811\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" Jul 15 22:20:44.032574 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:44.032481 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" Jul 15 22:20:44.365298 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:44.365251 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w"] Jul 15 22:20:44.376783 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:20:44.376752 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b9b2472_0d6f_4d95_acbe_8ea3ab45f811.slice/crio-f786164993ce3e3be7671d682fe9f3fdc36f221160be26e421538bfe1a292b56 WatchSource:0}: Error finding container f786164993ce3e3be7671d682fe9f3fdc36f221160be26e421538bfe1a292b56: Status 404 returned error can't find the container with id f786164993ce3e3be7671d682fe9f3fdc36f221160be26e421538bfe1a292b56 Jul 15 22:20:44.419372 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:44.419341 2564 generic.go:356] "Generic (PLEG): container finished" podID="1752e9a5-2883-4d44-acc4-def887077d41" containerID="73ebde340bad7a5aa783c0191568c5d57a2f653ed8100de2a4cf2f659ec191dc" exitCode=0 Jul 15 22:20:44.419499 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:44.419418 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" event={"ID":"1752e9a5-2883-4d44-acc4-def887077d41","Type":"ContainerDied","Data":"73ebde340bad7a5aa783c0191568c5d57a2f653ed8100de2a4cf2f659ec191dc"} Jul 15 22:20:44.420629 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:44.420611 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" event={"ID":"6b9b2472-0d6f-4d95-acbe-8ea3ab45f811","Type":"ContainerStarted","Data":"f786164993ce3e3be7671d682fe9f3fdc36f221160be26e421538bfe1a292b56"} Jul 15 22:20:45.426222 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:45.426191 2564 generic.go:356] "Generic (PLEG): container finished" podID="1752e9a5-2883-4d44-acc4-def887077d41" containerID="c924bc1dcee5acf5132a0c79b3fe15269862ff7953f642deb6e4e341b3e57825" exitCode=0 Jul 15 22:20:45.426620 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:45.426273 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" event={"ID":"1752e9a5-2883-4d44-acc4-def887077d41","Type":"ContainerDied","Data":"c924bc1dcee5acf5132a0c79b3fe15269862ff7953f642deb6e4e341b3e57825"} Jul 15 22:20:46.555151 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.555106 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:46.675198 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.675159 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-util\") pod \"1752e9a5-2883-4d44-acc4-def887077d41\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " Jul 15 22:20:46.675413 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.675214 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dh9v\" (UniqueName: \"kubernetes.io/projected/1752e9a5-2883-4d44-acc4-def887077d41-kube-api-access-4dh9v\") pod \"1752e9a5-2883-4d44-acc4-def887077d41\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " Jul 15 22:20:46.675413 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.675276 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-bundle\") pod \"1752e9a5-2883-4d44-acc4-def887077d41\" (UID: \"1752e9a5-2883-4d44-acc4-def887077d41\") " Jul 15 22:20:46.675698 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.675667 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-bundle" (OuterVolumeSpecName: "bundle") pod "1752e9a5-2883-4d44-acc4-def887077d41" (UID: "1752e9a5-2883-4d44-acc4-def887077d41"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:20:46.677298 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.677260 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1752e9a5-2883-4d44-acc4-def887077d41-kube-api-access-4dh9v" (OuterVolumeSpecName: "kube-api-access-4dh9v") pod "1752e9a5-2883-4d44-acc4-def887077d41" (UID: "1752e9a5-2883-4d44-acc4-def887077d41"). InnerVolumeSpecName "kube-api-access-4dh9v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:20:46.681001 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.680927 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-util" (OuterVolumeSpecName: "util") pod "1752e9a5-2883-4d44-acc4-def887077d41" (UID: "1752e9a5-2883-4d44-acc4-def887077d41"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:20:46.776102 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.776070 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:20:46.776102 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.776096 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dh9v\" (UniqueName: \"kubernetes.io/projected/1752e9a5-2883-4d44-acc4-def887077d41-kube-api-access-4dh9v\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:20:46.776102 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:46.776107 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1752e9a5-2883-4d44-acc4-def887077d41-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:20:47.436395 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.436359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" event={"ID":"1752e9a5-2883-4d44-acc4-def887077d41","Type":"ContainerDied","Data":"8a7375e73320521bba62086cc65a482c16aadfab5b5d6f6e374acd97898917f3"} Jul 15 22:20:47.436395 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.436390 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx5cd8" Jul 15 22:20:47.436571 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.436406 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a7375e73320521bba62086cc65a482c16aadfab5b5d6f6e374acd97898917f3" Jul 15 22:20:47.851879 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.851791 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cz9t9"] Jul 15 22:20:47.852295 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.852270 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1752e9a5-2883-4d44-acc4-def887077d41" containerName="extract" Jul 15 22:20:47.852380 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.852302 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1752e9a5-2883-4d44-acc4-def887077d41" containerName="extract" Jul 15 22:20:47.852380 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.852318 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1752e9a5-2883-4d44-acc4-def887077d41" containerName="pull" Jul 15 22:20:47.852380 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.852327 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1752e9a5-2883-4d44-acc4-def887077d41" containerName="pull" Jul 15 22:20:47.852380 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.852341 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1752e9a5-2883-4d44-acc4-def887077d41" containerName="util" Jul 15 22:20:47.852380 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.852349 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1752e9a5-2883-4d44-acc4-def887077d41" containerName="util" Jul 15 22:20:47.852574 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.852427 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1752e9a5-2883-4d44-acc4-def887077d41" containerName="extract" Jul 15 22:20:47.855495 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.855463 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:47.859515 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.859492 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-n555h\"" Jul 15 22:20:47.869565 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.869540 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cz9t9"] Jul 15 22:20:47.885908 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.885884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/071beab2-4b7e-41cb-baf9-9974619c28f7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cz9t9\" (UID: \"071beab2-4b7e-41cb-baf9-9974619c28f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:47.886036 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.885925 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbcl\" (UniqueName: \"kubernetes.io/projected/071beab2-4b7e-41cb-baf9-9974619c28f7-kube-api-access-7tbcl\") pod \"cert-manager-webhook-6486ffd997-cz9t9\" (UID: \"071beab2-4b7e-41cb-baf9-9974619c28f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:47.986588 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.986543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/071beab2-4b7e-41cb-baf9-9974619c28f7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cz9t9\" (UID: \"071beab2-4b7e-41cb-baf9-9974619c28f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:47.986772 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:47.986601 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbcl\" (UniqueName: \"kubernetes.io/projected/071beab2-4b7e-41cb-baf9-9974619c28f7-kube-api-access-7tbcl\") pod \"cert-manager-webhook-6486ffd997-cz9t9\" (UID: \"071beab2-4b7e-41cb-baf9-9974619c28f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:48.003367 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:48.003332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbcl\" (UniqueName: \"kubernetes.io/projected/071beab2-4b7e-41cb-baf9-9974619c28f7-kube-api-access-7tbcl\") pod \"cert-manager-webhook-6486ffd997-cz9t9\" (UID: \"071beab2-4b7e-41cb-baf9-9974619c28f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:48.004565 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:48.004540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/071beab2-4b7e-41cb-baf9-9974619c28f7-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cz9t9\" (UID: \"071beab2-4b7e-41cb-baf9-9974619c28f7\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:48.167188 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:48.167149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:48.328955 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:48.328929 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cz9t9"] Jul 15 22:20:48.331752 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:20:48.331719 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod071beab2_4b7e_41cb_baf9_9974619c28f7.slice/crio-33c54442b7823d3f0593cda86421065ad01bf98d422713050b50f7332627719e WatchSource:0}: Error finding container 33c54442b7823d3f0593cda86421065ad01bf98d422713050b50f7332627719e: Status 404 returned error can't find the container with id 33c54442b7823d3f0593cda86421065ad01bf98d422713050b50f7332627719e Jul 15 22:20:48.445363 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:48.445266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" event={"ID":"071beab2-4b7e-41cb-baf9-9974619c28f7","Type":"ContainerStarted","Data":"33c54442b7823d3f0593cda86421065ad01bf98d422713050b50f7332627719e"} Jul 15 22:20:50.461197 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:50.461158 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" event={"ID":"6b9b2472-0d6f-4d95-acbe-8ea3ab45f811","Type":"ContainerStarted","Data":"7e25e4ce76b59dbe4f1849e3f6de32fd0a4dbb9563fbddaaba33d0b68e879709"} Jul 15 22:20:50.462595 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:50.462572 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" event={"ID":"071beab2-4b7e-41cb-baf9-9974619c28f7","Type":"ContainerStarted","Data":"7ca147ac2461983df0e28e9252d99e2cf03f745e2409fd4dd392fc87da050c21"} Jul 15 22:20:50.462707 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:50.462693 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:50.494602 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:50.494550 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wmw8w" podStartSLOduration=2.046601802 podStartE2EDuration="7.494537295s" totalImagesPullingTime="5.447935493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:20:50.488011124 +0000 UTC m=+265.658668561" watchObservedRunningTime="2026-07-15 22:20:50.494537295 +0000 UTC m=+265.665194731" Jul 15 22:20:50.516971 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:50.516934 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" podStartSLOduration=2.023800837 podStartE2EDuration="3.516916846s" totalImagesPullingTime="1.493116009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:20:50.516099934 +0000 UTC m=+265.686757370" watchObservedRunningTime="2026-07-15 22:20:50.516916846 +0000 UTC m=+265.687574285" Jul 15 22:20:53.534426 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.534394 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2"] Jul 15 22:20:53.537558 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.537542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" Jul 15 22:20:53.541000 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.540980 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 22:20:53.541674 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.541658 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 22:20:53.541743 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.541665 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lpkdj\"" Jul 15 22:20:53.568529 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.568507 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2"] Jul 15 22:20:53.633898 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.633869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2595505e-0f98-4b38-9c75-c9f7b60c5df7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q8kb2\" (UID: \"2595505e-0f98-4b38-9c75-c9f7b60c5df7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" Jul 15 22:20:53.633991 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.633912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfz4\" (UniqueName: \"kubernetes.io/projected/2595505e-0f98-4b38-9c75-c9f7b60c5df7-kube-api-access-dpfz4\") pod \"openshift-lws-operator-fd8ccff4c-q8kb2\" (UID: \"2595505e-0f98-4b38-9c75-c9f7b60c5df7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" Jul 15 22:20:53.734717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.734693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2595505e-0f98-4b38-9c75-c9f7b60c5df7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q8kb2\" (UID: \"2595505e-0f98-4b38-9c75-c9f7b60c5df7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" Jul 15 22:20:53.734800 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.734727 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfz4\" (UniqueName: \"kubernetes.io/projected/2595505e-0f98-4b38-9c75-c9f7b60c5df7-kube-api-access-dpfz4\") pod \"openshift-lws-operator-fd8ccff4c-q8kb2\" (UID: \"2595505e-0f98-4b38-9c75-c9f7b60c5df7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" Jul 15 22:20:53.735025 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.735009 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2595505e-0f98-4b38-9c75-c9f7b60c5df7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q8kb2\" (UID: \"2595505e-0f98-4b38-9c75-c9f7b60c5df7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" Jul 15 22:20:53.755667 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.755643 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfz4\" (UniqueName: \"kubernetes.io/projected/2595505e-0f98-4b38-9c75-c9f7b60c5df7-kube-api-access-dpfz4\") pod \"openshift-lws-operator-fd8ccff4c-q8kb2\" (UID: \"2595505e-0f98-4b38-9c75-c9f7b60c5df7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" Jul 15 22:20:53.846433 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.846379 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" Jul 15 22:20:53.987511 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:53.987488 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2"] Jul 15 22:20:53.990026 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:20:53.990001 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2595505e_0f98_4b38_9c75_c9f7b60c5df7.slice/crio-4246d9f8b5dd40f1edbfe3281a072d9e5007201dce19e4856c3773505594de56 WatchSource:0}: Error finding container 4246d9f8b5dd40f1edbfe3281a072d9e5007201dce19e4856c3773505594de56: Status 404 returned error can't find the container with id 4246d9f8b5dd40f1edbfe3281a072d9e5007201dce19e4856c3773505594de56 Jul 15 22:20:54.480687 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:54.480655 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" event={"ID":"2595505e-0f98-4b38-9c75-c9f7b60c5df7","Type":"ContainerStarted","Data":"4246d9f8b5dd40f1edbfe3281a072d9e5007201dce19e4856c3773505594de56"} Jul 15 22:20:56.469277 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:56.469241 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cz9t9" Jul 15 22:20:58.499831 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:58.499800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" event={"ID":"2595505e-0f98-4b38-9c75-c9f7b60c5df7","Type":"ContainerStarted","Data":"0cf9d77828eae5c40886c25649f9f981dd28f09eb2febda3d5ba71cadf2e8063"} Jul 15 22:20:58.534277 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:20:58.534234 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q8kb2" podStartSLOduration=1.9529527629999999 podStartE2EDuration="5.534217782s" totalImagesPullingTime="3.581265019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:20:58.532993855 +0000 UTC m=+273.703651303" watchObservedRunningTime="2026-07-15 22:20:58.534217782 +0000 UTC m=+273.704875218" Jul 15 22:21:00.748514 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.748483 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c"] Jul 15 22:21:00.774400 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.774367 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c"] Jul 15 22:21:00.774534 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.774464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:00.778064 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.778034 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 22:21:00.778171 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.778131 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 22:21:00.778720 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.778703 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q5h95\"" Jul 15 22:21:00.889484 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.889462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:00.889591 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.889491 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:00.889591 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.889528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp7zh\" (UniqueName: \"kubernetes.io/projected/d32b3b1b-57fd-4d74-9503-5f7400b69262-kube-api-access-hp7zh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:00.990083 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.990060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:00.990170 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.990090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:00.990170 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.990123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp7zh\" (UniqueName: \"kubernetes.io/projected/d32b3b1b-57fd-4d74-9503-5f7400b69262-kube-api-access-hp7zh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:00.990457 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.990441 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:00.990523 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:00.990507 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:01.003530 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:01.003479 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp7zh\" (UniqueName: \"kubernetes.io/projected/d32b3b1b-57fd-4d74-9503-5f7400b69262-kube-api-access-hp7zh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:01.083477 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:01.083450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:01.229653 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:01.229629 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c"] Jul 15 22:21:01.232074 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:21:01.232049 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32b3b1b_57fd_4d74_9503_5f7400b69262.slice/crio-24057791b9d46be83679c570bb4d441909c75dfb1a93ebed384a712c3696fa1e WatchSource:0}: Error finding container 24057791b9d46be83679c570bb4d441909c75dfb1a93ebed384a712c3696fa1e: Status 404 returned error can't find the container with id 24057791b9d46be83679c570bb4d441909c75dfb1a93ebed384a712c3696fa1e Jul 15 22:21:01.514233 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:01.514195 2564 generic.go:356] "Generic (PLEG): container finished" podID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerID="f15589cc3161107e2385cd91556dc480e753226e5e8b22f416befe920e977df9" exitCode=0 Jul 15 22:21:01.514412 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:01.514302 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" event={"ID":"d32b3b1b-57fd-4d74-9503-5f7400b69262","Type":"ContainerDied","Data":"f15589cc3161107e2385cd91556dc480e753226e5e8b22f416befe920e977df9"} Jul 15 22:21:01.514412 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:01.514362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" event={"ID":"d32b3b1b-57fd-4d74-9503-5f7400b69262","Type":"ContainerStarted","Data":"24057791b9d46be83679c570bb4d441909c75dfb1a93ebed384a712c3696fa1e"} Jul 15 22:21:02.520649 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:02.520573 2564 generic.go:356] "Generic (PLEG): container finished" podID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerID="27e47bb6d8ef5dbce91ccdc54605fe9dc7bb58212580de5a351985b7e63aba29" exitCode=0 Jul 15 22:21:02.520649 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:02.520615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" event={"ID":"d32b3b1b-57fd-4d74-9503-5f7400b69262","Type":"ContainerDied","Data":"27e47bb6d8ef5dbce91ccdc54605fe9dc7bb58212580de5a351985b7e63aba29"} Jul 15 22:21:03.526937 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:03.526902 2564 generic.go:356] "Generic (PLEG): container finished" podID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerID="8199d6f075c9dc1add28dfc09ae8a55a42f94c815292a45ac1c8e37827d02f7a" exitCode=0 Jul 15 22:21:03.527277 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:03.526992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" event={"ID":"d32b3b1b-57fd-4d74-9503-5f7400b69262","Type":"ContainerDied","Data":"8199d6f075c9dc1add28dfc09ae8a55a42f94c815292a45ac1c8e37827d02f7a"} Jul 15 22:21:04.654435 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.654404 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:04.721389 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.721356 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-util\") pod \"d32b3b1b-57fd-4d74-9503-5f7400b69262\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " Jul 15 22:21:04.721542 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.721447 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp7zh\" (UniqueName: \"kubernetes.io/projected/d32b3b1b-57fd-4d74-9503-5f7400b69262-kube-api-access-hp7zh\") pod \"d32b3b1b-57fd-4d74-9503-5f7400b69262\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " Jul 15 22:21:04.721542 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.721492 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-bundle\") pod \"d32b3b1b-57fd-4d74-9503-5f7400b69262\" (UID: \"d32b3b1b-57fd-4d74-9503-5f7400b69262\") " Jul 15 22:21:04.722217 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.722185 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-bundle" (OuterVolumeSpecName: "bundle") pod "d32b3b1b-57fd-4d74-9503-5f7400b69262" (UID: "d32b3b1b-57fd-4d74-9503-5f7400b69262"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:21:04.723549 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.723518 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32b3b1b-57fd-4d74-9503-5f7400b69262-kube-api-access-hp7zh" (OuterVolumeSpecName: "kube-api-access-hp7zh") pod "d32b3b1b-57fd-4d74-9503-5f7400b69262" (UID: "d32b3b1b-57fd-4d74-9503-5f7400b69262"). InnerVolumeSpecName "kube-api-access-hp7zh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:21:04.726691 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.726668 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-util" (OuterVolumeSpecName: "util") pod "d32b3b1b-57fd-4d74-9503-5f7400b69262" (UID: "d32b3b1b-57fd-4d74-9503-5f7400b69262"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:21:04.822739 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.822655 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp7zh\" (UniqueName: \"kubernetes.io/projected/d32b3b1b-57fd-4d74-9503-5f7400b69262-kube-api-access-hp7zh\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:21:04.822739 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.822684 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:21:04.822739 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:04.822693 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d32b3b1b-57fd-4d74-9503-5f7400b69262-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:21:05.537863 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:05.537837 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" Jul 15 22:21:05.537863 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:05.537857 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkhr2c" event={"ID":"d32b3b1b-57fd-4d74-9503-5f7400b69262","Type":"ContainerDied","Data":"24057791b9d46be83679c570bb4d441909c75dfb1a93ebed384a712c3696fa1e"} Jul 15 22:21:05.538107 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:05.537910 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24057791b9d46be83679c570bb4d441909c75dfb1a93ebed384a712c3696fa1e" Jul 15 22:21:14.660686 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.660650 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68"] Jul 15 22:21:14.661080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.660959 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerName="extract" Jul 15 22:21:14.661080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.660970 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerName="extract" Jul 15 22:21:14.661080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.660982 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerName="pull" Jul 15 22:21:14.661080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.660987 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerName="pull" Jul 15 22:21:14.661080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.660997 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerName="util" Jul 15 22:21:14.661080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.661002 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerName="util" Jul 15 22:21:14.661080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.661052 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d32b3b1b-57fd-4d74-9503-5f7400b69262" containerName="extract" Jul 15 22:21:14.666533 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.666512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.674585 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.674562 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 22:21:14.674717 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.674701 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 22:21:14.674850 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.674834 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 22:21:14.675321 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.675304 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 22:21:14.681440 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.681424 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5pwh8\"" Jul 15 22:21:14.715242 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.715221 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68"] Jul 15 22:21:14.805104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.805078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.805104 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.805107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqrsd\" (UniqueName: \"kubernetes.io/projected/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-kube-api-access-jqrsd\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.805316 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.805131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.805316 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.805187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.805316 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.805244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.906244 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.906215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.906435 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.906252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqrsd\" (UniqueName: \"kubernetes.io/projected/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-kube-api-access-jqrsd\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.906435 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.906278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.906435 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.906336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.906435 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.906386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.906769 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.906740 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-manifests\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.908593 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.908571 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-tmp\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.908729 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.908711 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.908894 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.908875 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.924511 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.924452 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqrsd\" (UniqueName: \"kubernetes.io/projected/cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5-kube-api-access-jqrsd\") pod \"opendatahub-operator-controller-manager-7dbfb5d546-fqh68\" (UID: \"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5\") " pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:14.976257 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:14.976233 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:15.173677 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:21:15.173651 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2bc9e1_b1be_44e2_96f0_48d82fa2e9c5.slice/crio-9a33795dd1bced726e8338303733f9997c94b9e119a79036344fe4383415394b WatchSource:0}: Error finding container 9a33795dd1bced726e8338303733f9997c94b9e119a79036344fe4383415394b: Status 404 returned error can't find the container with id 9a33795dd1bced726e8338303733f9997c94b9e119a79036344fe4383415394b Jul 15 22:21:15.175549 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:15.175526 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68"] Jul 15 22:21:15.582630 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:15.582550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" event={"ID":"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5","Type":"ContainerStarted","Data":"9a33795dd1bced726e8338303733f9997c94b9e119a79036344fe4383415394b"} Jul 15 22:21:18.599082 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:18.599007 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" event={"ID":"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5","Type":"ContainerStarted","Data":"c4c51fe65a9339977798e7a74a7e98034b61959a0ca97ee82ddb9ca92528869f"} Jul 15 22:21:19.605618 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:19.605533 2564 generic.go:356] "Generic (PLEG): container finished" podID="cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5" containerID="c4c51fe65a9339977798e7a74a7e98034b61959a0ca97ee82ddb9ca92528869f" exitCode=0 Jul 15 22:21:19.605618 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:19.605580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" event={"ID":"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5","Type":"ContainerDied","Data":"c4c51fe65a9339977798e7a74a7e98034b61959a0ca97ee82ddb9ca92528869f"} Jul 15 22:21:21.617368 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:21.617335 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" event={"ID":"cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5","Type":"ContainerStarted","Data":"68616e029c21d57cd7547b43a5039856d9820420222e4df85576d471c4177a80"} Jul 15 22:21:21.617746 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:21.617556 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:21.727534 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:21.727492 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" podStartSLOduration=2.570006776 podStartE2EDuration="7.727477987s" totalImagesPullingTime="4.104080952s" totalInitContainerRuntime="1.053390259s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:21.712665943 +0000 UTC m=+296.883323379" watchObservedRunningTime="2026-07-15 22:21:21.727477987 +0000 UTC m=+296.898135423" Jul 15 22:21:25.211166 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:25.211138 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 22:21:32.624019 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:32.623989 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dbfb5d546-fqh68" Jul 15 22:21:37.850992 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.850957 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vzj8p"] Jul 15 22:21:37.854314 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.854277 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:37.858902 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.858882 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 15 22:21:37.859078 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.859062 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7pzpm\"" Jul 15 22:21:37.890020 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.889996 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vzj8p"] Jul 15 22:21:37.890268 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.890249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs\") pod \"model-serving-api-54d89bd5fc-vzj8p\" (UID: \"7de6d254-3f6a-41bd-9295-b8103d6da978\") " pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:37.890365 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.890305 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kcgw\" (UniqueName: \"kubernetes.io/projected/7de6d254-3f6a-41bd-9295-b8103d6da978-kube-api-access-9kcgw\") pod \"model-serving-api-54d89bd5fc-vzj8p\" (UID: \"7de6d254-3f6a-41bd-9295-b8103d6da978\") " pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:37.991558 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.991525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs\") pod \"model-serving-api-54d89bd5fc-vzj8p\" (UID: \"7de6d254-3f6a-41bd-9295-b8103d6da978\") " pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:37.991669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:37.991572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kcgw\" (UniqueName: \"kubernetes.io/projected/7de6d254-3f6a-41bd-9295-b8103d6da978-kube-api-access-9kcgw\") pod \"model-serving-api-54d89bd5fc-vzj8p\" (UID: \"7de6d254-3f6a-41bd-9295-b8103d6da978\") " pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:37.991734 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:21:37.991664 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 15 22:21:37.991734 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:21:37.991729 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs podName:7de6d254-3f6a-41bd-9295-b8103d6da978 nodeName:}" failed. No retries permitted until 2026-07-15 22:21:38.491712932 +0000 UTC m=+313.662370350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs") pod "model-serving-api-54d89bd5fc-vzj8p" (UID: "7de6d254-3f6a-41bd-9295-b8103d6da978") : secret "model-serving-api-tls" not found Jul 15 22:21:38.043935 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:38.043908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kcgw\" (UniqueName: \"kubernetes.io/projected/7de6d254-3f6a-41bd-9295-b8103d6da978-kube-api-access-9kcgw\") pod \"model-serving-api-54d89bd5fc-vzj8p\" (UID: \"7de6d254-3f6a-41bd-9295-b8103d6da978\") " pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:38.495262 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:38.495228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs\") pod \"model-serving-api-54d89bd5fc-vzj8p\" (UID: \"7de6d254-3f6a-41bd-9295-b8103d6da978\") " pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:38.495453 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:21:38.495366 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 15 22:21:38.495453 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:21:38.495425 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs podName:7de6d254-3f6a-41bd-9295-b8103d6da978 nodeName:}" failed. No retries permitted until 2026-07-15 22:21:39.495411703 +0000 UTC m=+314.666069118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs") pod "model-serving-api-54d89bd5fc-vzj8p" (UID: "7de6d254-3f6a-41bd-9295-b8103d6da978") : secret "model-serving-api-tls" not found Jul 15 22:21:39.502061 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:39.502028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs\") pod \"model-serving-api-54d89bd5fc-vzj8p\" (UID: \"7de6d254-3f6a-41bd-9295-b8103d6da978\") " pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:39.504406 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:39.504389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7de6d254-3f6a-41bd-9295-b8103d6da978-tls-certs\") pod \"model-serving-api-54d89bd5fc-vzj8p\" (UID: \"7de6d254-3f6a-41bd-9295-b8103d6da978\") " pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:39.664379 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:39.664352 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:39.801043 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:39.799395 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vzj8p"] Jul 15 22:21:39.804785 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:21:39.804757 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de6d254_3f6a_41bd_9295_b8103d6da978.slice/crio-fc770b3abdb97179385e9ae27c2acec22e392565ba94ee5467608b251e092917 WatchSource:0}: Error finding container fc770b3abdb97179385e9ae27c2acec22e392565ba94ee5467608b251e092917: Status 404 returned error can't find the container with id fc770b3abdb97179385e9ae27c2acec22e392565ba94ee5467608b251e092917 Jul 15 22:21:39.806553 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:39.806537 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:21:40.699845 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:40.699810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" event={"ID":"7de6d254-3f6a-41bd-9295-b8103d6da978","Type":"ContainerStarted","Data":"fc770b3abdb97179385e9ae27c2acec22e392565ba94ee5467608b251e092917"} Jul 15 22:21:41.524834 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.524800 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8547df878-4zbp2"] Jul 15 22:21:41.528086 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.528065 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.530779 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.530757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 22:21:41.531263 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.531241 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 22:21:41.531263 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.531262 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 22:21:41.531459 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.531279 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 22:21:41.532322 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.532304 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vngc6\"" Jul 15 22:21:41.549101 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.549080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8547df878-4zbp2"] Jul 15 22:21:41.620426 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.620405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpqtf\" (UniqueName: \"kubernetes.io/projected/3ddde4ae-5960-4368-b564-b660e92ff79e-kube-api-access-hpqtf\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.620523 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.620451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ddde4ae-5960-4368-b564-b660e92ff79e-tls-certs\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.620523 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.620468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ddde4ae-5960-4368-b564-b660e92ff79e-tmp\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.705406 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.705376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" event={"ID":"7de6d254-3f6a-41bd-9295-b8103d6da978","Type":"ContainerStarted","Data":"d41b241782497229ded3360415e7b7dc38b5fac0872cc6bf8de8921fcbe8661f"} Jul 15 22:21:41.705757 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.705442 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:41.720827 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.720801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqtf\" (UniqueName: \"kubernetes.io/projected/3ddde4ae-5960-4368-b564-b660e92ff79e-kube-api-access-hpqtf\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.720923 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.720852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ddde4ae-5960-4368-b564-b660e92ff79e-tls-certs\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.721046 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.721028 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ddde4ae-5960-4368-b564-b660e92ff79e-tmp\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.723072 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.723048 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ddde4ae-5960-4368-b564-b660e92ff79e-tmp\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.723175 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.723153 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ddde4ae-5960-4368-b564-b660e92ff79e-tls-certs\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.741124 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.741099 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpqtf\" (UniqueName: \"kubernetes.io/projected/3ddde4ae-5960-4368-b564-b660e92ff79e-kube-api-access-hpqtf\") pod \"kube-auth-proxy-8547df878-4zbp2\" (UID: \"3ddde4ae-5960-4368-b564-b660e92ff79e\") " pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.749410 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.749370 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" podStartSLOduration=2.992155624 podStartE2EDuration="4.749357397s" totalImagesPullingTime="1.757201773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:41.747967549 +0000 UTC m=+316.918624989" watchObservedRunningTime="2026-07-15 22:21:41.749357397 +0000 UTC m=+316.920014832" Jul 15 22:21:41.838250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.838193 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" Jul 15 22:21:41.990943 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:41.990871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8547df878-4zbp2"] Jul 15 22:21:41.993405 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:21:41.993353 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddde4ae_5960_4368_b564_b660e92ff79e.slice/crio-ab2a9ec12fe7fe9c059145f097dc0c9cc0e7a9fb164409e4bb63c7fdb2171922 WatchSource:0}: Error finding container ab2a9ec12fe7fe9c059145f097dc0c9cc0e7a9fb164409e4bb63c7fdb2171922: Status 404 returned error can't find the container with id ab2a9ec12fe7fe9c059145f097dc0c9cc0e7a9fb164409e4bb63c7fdb2171922 Jul 15 22:21:42.711235 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:42.711202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" event={"ID":"3ddde4ae-5960-4368-b564-b660e92ff79e","Type":"ContainerStarted","Data":"ab2a9ec12fe7fe9c059145f097dc0c9cc0e7a9fb164409e4bb63c7fdb2171922"} Jul 15 22:21:43.793162 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.793128 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4"] Jul 15 22:21:43.796826 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.796804 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.807132 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.807112 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 22:21:43.807481 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.807446 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-f2bb2\"" Jul 15 22:21:43.808379 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.808356 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 22:21:43.811356 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.811337 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 22:21:43.812683 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.812657 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 22:21:43.837536 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.837470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.837536 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.837514 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.837719 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.837551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad13bdb4-ba0c-451e-8092-8145f173eb3a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.837719 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.837566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.837719 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.837670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxcwc\" (UniqueName: \"kubernetes.io/projected/ad13bdb4-ba0c-451e-8092-8145f173eb3a-kube-api-access-mxcwc\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.837872 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.837755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.837872 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.837787 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.848090 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.848068 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4"] Jul 15 22:21:43.938760 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.938728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.938917 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.938783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad13bdb4-ba0c-451e-8092-8145f173eb3a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.938917 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.938807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.938917 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.938864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxcwc\" (UniqueName: \"kubernetes.io/projected/ad13bdb4-ba0c-451e-8092-8145f173eb3a-kube-api-access-mxcwc\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.939199 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.938922 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.939199 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.938947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.939199 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.938977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.939572 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.939503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.941678 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.941653 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad13bdb4-ba0c-451e-8092-8145f173eb3a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.941768 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.941679 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.941859 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.941832 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.942492 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.942363 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:43.960576 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:43.960552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxcwc\" (UniqueName: \"kubernetes.io/projected/ad13bdb4-ba0c-451e-8092-8145f173eb3a-kube-api-access-mxcwc\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:44.009671 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:44.009641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad13bdb4-ba0c-451e-8092-8145f173eb3a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xcgt4\" (UID: \"ad13bdb4-ba0c-451e-8092-8145f173eb3a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:44.109052 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:44.108986 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:44.846976 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:44.846951 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4"] Jul 15 22:21:44.848957 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:21:44.848935 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad13bdb4_ba0c_451e_8092_8145f173eb3a.slice/crio-120c912fe621b0edaef9199648b0ba0458d5a9bdd76f1b4f522974a9aad19ca7 WatchSource:0}: Error finding container 120c912fe621b0edaef9199648b0ba0458d5a9bdd76f1b4f522974a9aad19ca7: Status 404 returned error can't find the container with id 120c912fe621b0edaef9199648b0ba0458d5a9bdd76f1b4f522974a9aad19ca7 Jul 15 22:21:45.732964 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:45.732915 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" event={"ID":"3ddde4ae-5960-4368-b564-b660e92ff79e","Type":"ContainerStarted","Data":"0db4115c9334b547cf5c33468a13486c2cb25793e0f0e703737d99aaf0791930"} Jul 15 22:21:45.734669 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:45.734558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" event={"ID":"ad13bdb4-ba0c-451e-8092-8145f173eb3a","Type":"ContainerStarted","Data":"120c912fe621b0edaef9199648b0ba0458d5a9bdd76f1b4f522974a9aad19ca7"} Jul 15 22:21:45.783754 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:45.783699 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8547df878-4zbp2" podStartSLOduration=2.025357488 podStartE2EDuration="4.783677323s" totalImagesPullingTime="2.758319835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:45.781980641 +0000 UTC m=+320.952638078" watchObservedRunningTime="2026-07-15 22:21:45.783677323 +0000 UTC m=+320.954334760" Jul 15 22:21:47.228775 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:47.228736 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 22:21:47.229006 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:47.228815 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 15 22:21:47.746535 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:47.746499 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" event={"ID":"ad13bdb4-ba0c-451e-8092-8145f173eb3a","Type":"ContainerStarted","Data":"8ec922431b593825962ed7f8b6510c54855ce52ae26321c4b76c0d7c90e7c776"} Jul 15 22:21:47.746731 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:47.746555 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:47.816426 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:47.816376 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" podStartSLOduration=2.439064546 podStartE2EDuration="4.816360537s" totalImagesPullingTime="2.377295991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:47.814201837 +0000 UTC m=+322.984859274" watchObservedRunningTime="2026-07-15 22:21:47.816360537 +0000 UTC m=+322.987017973" Jul 15 22:21:48.752957 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:48.752917 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-xcgt4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 22:21:48.753441 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:48.752981 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" podUID="ad13bdb4-ba0c-451e-8092-8145f173eb3a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 22:21:49.953345 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:49.953311 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz"] Jul 15 22:21:49.973383 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:49.973360 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq"] Jul 15 22:21:49.973499 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:49.973478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:49.979699 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:21:49.979667 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-controller-manager-dockercfg-zfk5b\" is forbidden: User \"system:node:ip-10-0-136-87.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-87.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zfk5b\"" type="*v1.Secret" Jul 15 22:21:49.979990 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:49.979969 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 15 22:21:49.981801 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:49.981783 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:49.988468 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:49.988451 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hd2fc\"" Jul 15 22:21:49.988690 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:49.988678 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 15 22:21:50.095779 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.095756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/286c5119-8502-49e1-8de4-f0a8005c8d4b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wnwcz\" (UID: \"286c5119-8502-49e1-8de4-f0a8005c8d4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:50.095874 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.095792 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mftmk\" (UniqueName: \"kubernetes.io/projected/286c5119-8502-49e1-8de4-f0a8005c8d4b-kube-api-access-mftmk\") pod \"llmisvc-controller-manager-777c6bd7d5-wnwcz\" (UID: \"286c5119-8502-49e1-8de4-f0a8005c8d4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:50.095874 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.095823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrcd\" (UniqueName: \"kubernetes.io/projected/a6e7ca22-a5e1-4034-8d26-9a7aeefce81d-kube-api-access-vcrcd\") pod \"kserve-controller-manager-d6f4b65b8-j6rxq\" (UID: \"a6e7ca22-a5e1-4034-8d26-9a7aeefce81d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:50.095944 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.095889 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6e7ca22-a5e1-4034-8d26-9a7aeefce81d-cert\") pod \"kserve-controller-manager-d6f4b65b8-j6rxq\" (UID: \"a6e7ca22-a5e1-4034-8d26-9a7aeefce81d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:50.123023 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.122999 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz"] Jul 15 22:21:50.167157 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.167130 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq"] Jul 15 22:21:50.196866 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.196841 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/286c5119-8502-49e1-8de4-f0a8005c8d4b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wnwcz\" (UID: \"286c5119-8502-49e1-8de4-f0a8005c8d4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:50.196959 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.196875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mftmk\" (UniqueName: \"kubernetes.io/projected/286c5119-8502-49e1-8de4-f0a8005c8d4b-kube-api-access-mftmk\") pod \"llmisvc-controller-manager-777c6bd7d5-wnwcz\" (UID: \"286c5119-8502-49e1-8de4-f0a8005c8d4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:50.196959 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.196903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrcd\" (UniqueName: \"kubernetes.io/projected/a6e7ca22-a5e1-4034-8d26-9a7aeefce81d-kube-api-access-vcrcd\") pod \"kserve-controller-manager-d6f4b65b8-j6rxq\" (UID: \"a6e7ca22-a5e1-4034-8d26-9a7aeefce81d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:50.197031 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.196959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6e7ca22-a5e1-4034-8d26-9a7aeefce81d-cert\") pod \"kserve-controller-manager-d6f4b65b8-j6rxq\" (UID: \"a6e7ca22-a5e1-4034-8d26-9a7aeefce81d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:50.199299 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.199259 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/286c5119-8502-49e1-8de4-f0a8005c8d4b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wnwcz\" (UID: \"286c5119-8502-49e1-8de4-f0a8005c8d4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:50.199380 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.199297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6e7ca22-a5e1-4034-8d26-9a7aeefce81d-cert\") pod \"kserve-controller-manager-d6f4b65b8-j6rxq\" (UID: \"a6e7ca22-a5e1-4034-8d26-9a7aeefce81d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:50.207247 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.207193 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrcd\" (UniqueName: \"kubernetes.io/projected/a6e7ca22-a5e1-4034-8d26-9a7aeefce81d-kube-api-access-vcrcd\") pod \"kserve-controller-manager-d6f4b65b8-j6rxq\" (UID: \"a6e7ca22-a5e1-4034-8d26-9a7aeefce81d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:50.207915 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.207898 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mftmk\" (UniqueName: \"kubernetes.io/projected/286c5119-8502-49e1-8de4-f0a8005c8d4b-kube-api-access-mftmk\") pod \"llmisvc-controller-manager-777c6bd7d5-wnwcz\" (UID: \"286c5119-8502-49e1-8de4-f0a8005c8d4b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:50.290572 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.290553 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:50.500302 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.500264 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq"] Jul 15 22:21:50.502572 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:21:50.502535 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e7ca22_a5e1_4034_8d26_9a7aeefce81d.slice/crio-930d149e44f915e958e97ab1b303a5a4455da8fcbff241fdd0037134f93c1b39 WatchSource:0}: Error finding container 930d149e44f915e958e97ab1b303a5a4455da8fcbff241fdd0037134f93c1b39: Status 404 returned error can't find the container with id 930d149e44f915e958e97ab1b303a5a4455da8fcbff241fdd0037134f93c1b39 Jul 15 22:21:50.762819 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:50.762735 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" event={"ID":"a6e7ca22-a5e1-4034-8d26-9a7aeefce81d","Type":"ContainerStarted","Data":"930d149e44f915e958e97ab1b303a5a4455da8fcbff241fdd0037134f93c1b39"} Jul 15 22:21:51.283341 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:51.283310 2564 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jul 15 22:21:51.283699 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:51.283381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:51.463019 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:51.462993 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz"] Jul 15 22:21:51.464626 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:21:51.464590 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod286c5119_8502_49e1_8de4_f0a8005c8d4b.slice/crio-3087572c6759993c382d3948e18eb3c07b147ec129008676a76e59267fd3c997 WatchSource:0}: Error finding container 3087572c6759993c382d3948e18eb3c07b147ec129008676a76e59267fd3c997: Status 404 returned error can't find the container with id 3087572c6759993c382d3948e18eb3c07b147ec129008676a76e59267fd3c997 Jul 15 22:21:51.499195 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:51.499095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zfk5b\"" Jul 15 22:21:51.752013 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:51.751985 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcgt4" Jul 15 22:21:51.768171 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:51.768145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" event={"ID":"286c5119-8502-49e1-8de4-f0a8005c8d4b","Type":"ContainerStarted","Data":"3087572c6759993c382d3948e18eb3c07b147ec129008676a76e59267fd3c997"} Jul 15 22:21:52.717683 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:52.717657 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vzj8p" Jul 15 22:21:53.783256 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:53.783161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" event={"ID":"a6e7ca22-a5e1-4034-8d26-9a7aeefce81d","Type":"ContainerStarted","Data":"3a60a0069a0fb39f6840fd956b04bb43fc64a86d840aa6c5b55c3fcebe2069b0"} Jul 15 22:21:53.783256 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:53.783238 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:21:53.830433 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:53.830377 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" podStartSLOduration=1.8526318480000001 podStartE2EDuration="4.83035998s" totalImagesPullingTime="2.977728132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:53.829489571 +0000 UTC m=+329.000147008" watchObservedRunningTime="2026-07-15 22:21:53.83035998 +0000 UTC m=+329.001017393" Jul 15 22:21:55.795547 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:55.795511 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" event={"ID":"286c5119-8502-49e1-8de4-f0a8005c8d4b","Type":"ContainerStarted","Data":"ae46b4973e4d3f2f323a697d563d3cd860acdafeda56ef3995bfea289a1a6308"} Jul 15 22:21:55.795953 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:55.795590 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:21:55.816435 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:21:55.816390 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" podStartSLOduration=3.515983229 podStartE2EDuration="6.816375572s" totalImagesPullingTime="3.300392343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:21:55.814919809 +0000 UTC m=+330.985577246" watchObservedRunningTime="2026-07-15 22:21:55.816375572 +0000 UTC m=+330.987033039" Jul 15 22:22:24.794891 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:24.794802 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-j6rxq" Jul 15 22:22:26.803167 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:26.803139 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wnwcz" Jul 15 22:22:36.402522 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.402484 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rnznx"] Jul 15 22:22:36.408716 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.408692 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" Jul 15 22:22:36.412107 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.412087 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 22:22:36.413121 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.413102 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 22:22:36.413199 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.413103 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9b22f\"" Jul 15 22:22:36.419460 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.419439 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rnznx"] Jul 15 22:22:36.466105 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.466074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkj4k\" (UniqueName: \"kubernetes.io/projected/e5cc4c84-8b90-40e3-a818-d77236e1b46b-kube-api-access-zkj4k\") pod \"kuadrant-operator-catalog-rnznx\" (UID: \"e5cc4c84-8b90-40e3-a818-d77236e1b46b\") " pod="kuadrant-system/kuadrant-operator-catalog-rnznx" Jul 15 22:22:36.566958 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.566932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkj4k\" (UniqueName: \"kubernetes.io/projected/e5cc4c84-8b90-40e3-a818-d77236e1b46b-kube-api-access-zkj4k\") pod \"kuadrant-operator-catalog-rnznx\" (UID: \"e5cc4c84-8b90-40e3-a818-d77236e1b46b\") " pod="kuadrant-system/kuadrant-operator-catalog-rnznx" Jul 15 22:22:36.576693 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.576671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkj4k\" (UniqueName: \"kubernetes.io/projected/e5cc4c84-8b90-40e3-a818-d77236e1b46b-kube-api-access-zkj4k\") pod \"kuadrant-operator-catalog-rnznx\" (UID: \"e5cc4c84-8b90-40e3-a818-d77236e1b46b\") " pod="kuadrant-system/kuadrant-operator-catalog-rnznx" Jul 15 22:22:36.719109 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.719054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" Jul 15 22:22:36.746749 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.746715 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rnznx"] Jul 15 22:22:36.852108 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.852083 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rnznx"] Jul 15 22:22:36.854638 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:22:36.854614 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5cc4c84_8b90_40e3_a818_d77236e1b46b.slice/crio-1a6aea83ff7a732f0552773c37cd5a3151b8673f61bc6ac7a15b2002ef60f384 WatchSource:0}: Error finding container 1a6aea83ff7a732f0552773c37cd5a3151b8673f61bc6ac7a15b2002ef60f384: Status 404 returned error can't find the container with id 1a6aea83ff7a732f0552773c37cd5a3151b8673f61bc6ac7a15b2002ef60f384 Jul 15 22:22:36.971981 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.971923 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vddjt"] Jul 15 22:22:36.974605 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.974589 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:36.987713 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.987689 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vddjt"] Jul 15 22:22:36.990616 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:36.990588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" event={"ID":"e5cc4c84-8b90-40e3-a818-d77236e1b46b","Type":"ContainerStarted","Data":"1a6aea83ff7a732f0552773c37cd5a3151b8673f61bc6ac7a15b2002ef60f384"} Jul 15 22:22:37.071470 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:37.071443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qrl\" (UniqueName: \"kubernetes.io/projected/2109285c-833c-4790-a242-ad32c551c9bf-kube-api-access-55qrl\") pod \"kuadrant-operator-catalog-vddjt\" (UID: \"2109285c-833c-4790-a242-ad32c551c9bf\") " pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:37.171934 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:37.171908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55qrl\" (UniqueName: \"kubernetes.io/projected/2109285c-833c-4790-a242-ad32c551c9bf-kube-api-access-55qrl\") pod \"kuadrant-operator-catalog-vddjt\" (UID: \"2109285c-833c-4790-a242-ad32c551c9bf\") " pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:37.183514 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:37.183488 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qrl\" (UniqueName: \"kubernetes.io/projected/2109285c-833c-4790-a242-ad32c551c9bf-kube-api-access-55qrl\") pod \"kuadrant-operator-catalog-vddjt\" (UID: \"2109285c-833c-4790-a242-ad32c551c9bf\") " pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:37.283743 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:37.283689 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:37.415882 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:37.415858 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vddjt"] Jul 15 22:22:37.419205 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:22:37.419180 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2109285c_833c_4790_a242_ad32c551c9bf.slice/crio-d7acaaf32dc1db7651f3f5826bf39675bd6d676fbcb9a9d07576ddcc540d7444 WatchSource:0}: Error finding container d7acaaf32dc1db7651f3f5826bf39675bd6d676fbcb9a9d07576ddcc540d7444: Status 404 returned error can't find the container with id d7acaaf32dc1db7651f3f5826bf39675bd6d676fbcb9a9d07576ddcc540d7444 Jul 15 22:22:38.002492 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:38.002451 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" event={"ID":"2109285c-833c-4790-a242-ad32c551c9bf","Type":"ContainerStarted","Data":"d7acaaf32dc1db7651f3f5826bf39675bd6d676fbcb9a9d07576ddcc540d7444"} Jul 15 22:22:39.029821 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:39.029757 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" podStartSLOduration=1.510858667 podStartE2EDuration="3.029734702s" totalImagesPullingTime="1.518876035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:22:39.02895549 +0000 UTC m=+374.199612941" watchObservedRunningTime="2026-07-15 22:22:39.029734702 +0000 UTC m=+374.200392139" Jul 15 22:22:40.018466 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:40.018426 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" event={"ID":"e5cc4c84-8b90-40e3-a818-d77236e1b46b","Type":"ContainerStarted","Data":"ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac"} Jul 15 22:22:40.018672 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:40.018468 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" podUID="e5cc4c84-8b90-40e3-a818-d77236e1b46b" containerName="registry-server" containerID="cri-o://ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac" gracePeriod=2 Jul 15 22:22:40.020020 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:40.019989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" event={"ID":"2109285c-833c-4790-a242-ad32c551c9bf","Type":"ContainerStarted","Data":"12607373de33d9a15168cc5b073c11e6b5d3ed9294cf8fac22cdbcbdcfe73cec"} Jul 15 22:22:40.042800 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:40.042756 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" podStartSLOduration=1.962105378 podStartE2EDuration="4.042744428s" totalImagesPullingTime="2.08063905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:22:40.03978023 +0000 UTC m=+375.210437679" watchObservedRunningTime="2026-07-15 22:22:40.042744428 +0000 UTC m=+375.213401863" Jul 15 22:22:40.256267 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:40.256245 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" Jul 15 22:22:40.300454 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:40.300397 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkj4k\" (UniqueName: \"kubernetes.io/projected/e5cc4c84-8b90-40e3-a818-d77236e1b46b-kube-api-access-zkj4k\") pod \"e5cc4c84-8b90-40e3-a818-d77236e1b46b\" (UID: \"e5cc4c84-8b90-40e3-a818-d77236e1b46b\") " Jul 15 22:22:40.302428 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:40.302400 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5cc4c84-8b90-40e3-a818-d77236e1b46b-kube-api-access-zkj4k" (OuterVolumeSpecName: "kube-api-access-zkj4k") pod "e5cc4c84-8b90-40e3-a818-d77236e1b46b" (UID: "e5cc4c84-8b90-40e3-a818-d77236e1b46b"). InnerVolumeSpecName "kube-api-access-zkj4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:22:40.401688 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:40.401654 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkj4k\" (UniqueName: \"kubernetes.io/projected/e5cc4c84-8b90-40e3-a818-d77236e1b46b-kube-api-access-zkj4k\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:41.025217 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.025187 2564 generic.go:356] "Generic (PLEG): container finished" podID="e5cc4c84-8b90-40e3-a818-d77236e1b46b" containerID="ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac" exitCode=0 Jul 15 22:22:41.025402 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.025225 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" Jul 15 22:22:41.025402 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.025249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" event={"ID":"e5cc4c84-8b90-40e3-a818-d77236e1b46b","Type":"ContainerDied","Data":"ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac"} Jul 15 22:22:41.025402 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.025302 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rnznx" event={"ID":"e5cc4c84-8b90-40e3-a818-d77236e1b46b","Type":"ContainerDied","Data":"1a6aea83ff7a732f0552773c37cd5a3151b8673f61bc6ac7a15b2002ef60f384"} Jul 15 22:22:41.025402 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.025326 2564 scope.go:117] "RemoveContainer" containerID="ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac" Jul 15 22:22:41.034885 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.034871 2564 scope.go:117] "RemoveContainer" containerID="ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac" Jul 15 22:22:41.035091 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:22:41.035073 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac\": container with ID starting with ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac not found: ID does not exist" containerID="ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac" Jul 15 22:22:41.035134 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.035100 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac"} err="failed to get container status \"ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac\": rpc error: code = NotFound desc = could not find container \"ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac\": container with ID starting with ca6738735c21be78d18967be21e444e991189e3faa1bdf9db9b73abb6244f1ac not found: ID does not exist" Jul 15 22:22:41.048180 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.048158 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rnznx"] Jul 15 22:22:41.051711 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.051693 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rnznx"] Jul 15 22:22:41.371856 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:41.371776 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5cc4c84-8b90-40e3-a818-d77236e1b46b" path="/var/lib/kubelet/pods/e5cc4c84-8b90-40e3-a818-d77236e1b46b/volumes" Jul 15 22:22:47.284345 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:47.284313 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:47.284742 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:47.284367 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:47.306854 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:47.306830 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:48.087776 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:48.087751 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vddjt" Jul 15 22:22:52.200624 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.200593 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6"] Jul 15 22:22:52.200988 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.200939 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cc4c84-8b90-40e3-a818-d77236e1b46b" containerName="registry-server" Jul 15 22:22:52.200988 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.200951 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cc4c84-8b90-40e3-a818-d77236e1b46b" containerName="registry-server" Jul 15 22:22:52.201062 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.201012 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cc4c84-8b90-40e3-a818-d77236e1b46b" containerName="registry-server" Jul 15 22:22:52.204140 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.204122 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.206991 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.206970 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-klg4c\"" Jul 15 22:22:52.214331 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.214309 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6"] Jul 15 22:22:52.296344 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.296308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.296466 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.296347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhw44\" (UniqueName: \"kubernetes.io/projected/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-kube-api-access-bhw44\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.296466 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.296374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.397309 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.397262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.397440 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.397331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhw44\" (UniqueName: \"kubernetes.io/projected/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-kube-api-access-bhw44\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.397440 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.397374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.397627 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.397594 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.397721 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.397703 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.406355 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.406336 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhw44\" (UniqueName: \"kubernetes.io/projected/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-kube-api-access-bhw44\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.513333 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.513244 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:52.649325 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.649302 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6"] Jul 15 22:22:52.651080 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:22:52.651052 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbaaa2d_c919_4632_8d5c_c1f275fec69e.slice/crio-92eafdb92b713fc0c3ac876b560fe51f1f16e224c7096aa8c8afb851059e6f2d WatchSource:0}: Error finding container 92eafdb92b713fc0c3ac876b560fe51f1f16e224c7096aa8c8afb851059e6f2d: Status 404 returned error can't find the container with id 92eafdb92b713fc0c3ac876b560fe51f1f16e224c7096aa8c8afb851059e6f2d Jul 15 22:22:52.797914 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.797853 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht"] Jul 15 22:22:52.801196 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.801181 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:52.810407 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.810381 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht"] Jul 15 22:22:52.901149 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.901120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:52.901263 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.901154 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rkjz\" (UniqueName: \"kubernetes.io/projected/b49d5582-524e-49af-bbd0-64c5dc0a8904-kube-api-access-6rkjz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:52.901263 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:52.901184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:53.002013 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.001981 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:53.002119 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.002023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rkjz\" (UniqueName: \"kubernetes.io/projected/b49d5582-524e-49af-bbd0-64c5dc0a8904-kube-api-access-6rkjz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:53.002187 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.002142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:53.002356 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.002340 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:53.002457 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.002441 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:53.010765 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.010748 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rkjz\" (UniqueName: \"kubernetes.io/projected/b49d5582-524e-49af-bbd0-64c5dc0a8904-kube-api-access-6rkjz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:53.092118 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.092061 2564 generic.go:356] "Generic (PLEG): container finished" podID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerID="287bfa9c7e8246d45fe6af24179f9e82744404265b3c0ad066486ff0a56b38e4" exitCode=0 Jul 15 22:22:53.092118 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.092090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" event={"ID":"6fbaaa2d-c919-4632-8d5c-c1f275fec69e","Type":"ContainerDied","Data":"287bfa9c7e8246d45fe6af24179f9e82744404265b3c0ad066486ff0a56b38e4"} Jul 15 22:22:53.092118 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.092120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" event={"ID":"6fbaaa2d-c919-4632-8d5c-c1f275fec69e","Type":"ContainerStarted","Data":"92eafdb92b713fc0c3ac876b560fe51f1f16e224c7096aa8c8afb851059e6f2d"} Jul 15 22:22:53.118511 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.118490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:53.246250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.246223 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht"] Jul 15 22:22:53.248043 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:22:53.248016 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49d5582_524e_49af_bbd0_64c5dc0a8904.slice/crio-acc1f18ca1d07231faa19114a74ac9b5fceab4bb2f9c5cf38f94c220263bf6d5 WatchSource:0}: Error finding container acc1f18ca1d07231faa19114a74ac9b5fceab4bb2f9c5cf38f94c220263bf6d5: Status 404 returned error can't find the container with id acc1f18ca1d07231faa19114a74ac9b5fceab4bb2f9c5cf38f94c220263bf6d5 Jul 15 22:22:53.401478 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.401450 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6"] Jul 15 22:22:53.404858 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.404841 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.414899 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.414877 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6"] Jul 15 22:22:53.505828 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.505803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z26x2\" (UniqueName: \"kubernetes.io/projected/80dab9d1-2dc7-4347-b8fc-8b30327d7631-kube-api-access-z26x2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.505966 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.505866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.505966 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.505894 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.606401 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.606339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z26x2\" (UniqueName: \"kubernetes.io/projected/80dab9d1-2dc7-4347-b8fc-8b30327d7631-kube-api-access-z26x2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.606401 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.606394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.606574 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.606420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.606752 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.606733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.606822 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.606769 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.616120 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.616100 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z26x2\" (UniqueName: \"kubernetes.io/projected/80dab9d1-2dc7-4347-b8fc-8b30327d7631-kube-api-access-z26x2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.724368 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.724343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:53.839476 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.839441 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br"] Jul 15 22:22:53.844166 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.844135 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:53.846037 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.846012 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br"] Jul 15 22:22:53.861112 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.861092 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6"] Jul 15 22:22:53.863137 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:22:53.863084 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80dab9d1_2dc7_4347_b8fc_8b30327d7631.slice/crio-5c1b6ac75c0dae8b7d25d40a80f5dabe53ea8d7e82be2982a84a2c9b83083057 WatchSource:0}: Error finding container 5c1b6ac75c0dae8b7d25d40a80f5dabe53ea8d7e82be2982a84a2c9b83083057: Status 404 returned error can't find the container with id 5c1b6ac75c0dae8b7d25d40a80f5dabe53ea8d7e82be2982a84a2c9b83083057 Jul 15 22:22:53.908397 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.908368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc2pl\" (UniqueName: \"kubernetes.io/projected/131009fc-f0f4-4738-86a2-1b94a8adc343-kube-api-access-xc2pl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:53.908473 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.908438 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:53.908522 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:53.908483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:54.009860 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.009829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc2pl\" (UniqueName: \"kubernetes.io/projected/131009fc-f0f4-4738-86a2-1b94a8adc343-kube-api-access-xc2pl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:54.010021 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.009874 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:54.010021 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.009899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:54.010277 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.010256 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:54.010369 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.010277 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:54.019973 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.019950 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc2pl\" (UniqueName: \"kubernetes.io/projected/131009fc-f0f4-4738-86a2-1b94a8adc343-kube-api-access-xc2pl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:54.100252 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.100218 2564 generic.go:356] "Generic (PLEG): container finished" podID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerID="f8097026167b70fcece22b4dabc21192263f9403b0056dfb0b314662ec01dcdf" exitCode=0 Jul 15 22:22:54.100388 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.100317 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" event={"ID":"b49d5582-524e-49af-bbd0-64c5dc0a8904","Type":"ContainerDied","Data":"f8097026167b70fcece22b4dabc21192263f9403b0056dfb0b314662ec01dcdf"} Jul 15 22:22:54.100388 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.100374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" event={"ID":"b49d5582-524e-49af-bbd0-64c5dc0a8904","Type":"ContainerStarted","Data":"acc1f18ca1d07231faa19114a74ac9b5fceab4bb2f9c5cf38f94c220263bf6d5"} Jul 15 22:22:54.101823 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.101800 2564 generic.go:356] "Generic (PLEG): container finished" podID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerID="5cc676393c88d3f9c13f01e2e034e8aef725f9a3d6a0f30561d396de379bc5ea" exitCode=0 Jul 15 22:22:54.101956 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.101826 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" event={"ID":"80dab9d1-2dc7-4347-b8fc-8b30327d7631","Type":"ContainerDied","Data":"5cc676393c88d3f9c13f01e2e034e8aef725f9a3d6a0f30561d396de379bc5ea"} Jul 15 22:22:54.101956 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.101867 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" event={"ID":"80dab9d1-2dc7-4347-b8fc-8b30327d7631","Type":"ContainerStarted","Data":"5c1b6ac75c0dae8b7d25d40a80f5dabe53ea8d7e82be2982a84a2c9b83083057"} Jul 15 22:22:54.154325 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.154305 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:54.285974 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:54.285950 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br"] Jul 15 22:22:54.287591 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:22:54.287565 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131009fc_f0f4_4738_86a2_1b94a8adc343.slice/crio-c7d9b1ca447e76a3d92531178458e6aee15c7f5e7f8161459d1fb1ab038163be WatchSource:0}: Error finding container c7d9b1ca447e76a3d92531178458e6aee15c7f5e7f8161459d1fb1ab038163be: Status 404 returned error can't find the container with id c7d9b1ca447e76a3d92531178458e6aee15c7f5e7f8161459d1fb1ab038163be Jul 15 22:22:55.109417 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:55.109392 2564 generic.go:356] "Generic (PLEG): container finished" podID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerID="98f85d4d5a17689f8389fa792fd9c4502e44015081f64df2bfbcbd6e4a0f66f4" exitCode=0 Jul 15 22:22:55.109520 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:55.109459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" event={"ID":"6fbaaa2d-c919-4632-8d5c-c1f275fec69e","Type":"ContainerDied","Data":"98f85d4d5a17689f8389fa792fd9c4502e44015081f64df2bfbcbd6e4a0f66f4"} Jul 15 22:22:55.111584 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:55.111553 2564 generic.go:356] "Generic (PLEG): container finished" podID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerID="81e10cf26fdb0c7039ec973d3d598d2e47e9dfe192ce1996c17c1b4d7d922c9b" exitCode=0 Jul 15 22:22:55.111690 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:55.111630 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" event={"ID":"80dab9d1-2dc7-4347-b8fc-8b30327d7631","Type":"ContainerDied","Data":"81e10cf26fdb0c7039ec973d3d598d2e47e9dfe192ce1996c17c1b4d7d922c9b"} Jul 15 22:22:55.113485 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:55.113462 2564 generic.go:356] "Generic (PLEG): container finished" podID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerID="71c2db6b9201f8a331338b5438aef867058bfa7a86916ef4b5dab69d55849877" exitCode=0 Jul 15 22:22:55.113584 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:55.113493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" event={"ID":"131009fc-f0f4-4738-86a2-1b94a8adc343","Type":"ContainerDied","Data":"71c2db6b9201f8a331338b5438aef867058bfa7a86916ef4b5dab69d55849877"} Jul 15 22:22:55.113584 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:55.113543 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" event={"ID":"131009fc-f0f4-4738-86a2-1b94a8adc343","Type":"ContainerStarted","Data":"c7d9b1ca447e76a3d92531178458e6aee15c7f5e7f8161459d1fb1ab038163be"} Jul 15 22:22:55.115688 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:55.115659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" event={"ID":"b49d5582-524e-49af-bbd0-64c5dc0a8904","Type":"ContainerStarted","Data":"5dabd0dbc869e04c827040f42a51b41c22483d4c0af5c7a5bd34d622d67748f5"} Jul 15 22:22:56.122780 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:56.122706 2564 generic.go:356] "Generic (PLEG): container finished" podID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerID="12eac6de51b75affc10ef2e0a792e20572c8986cfb6e31cb33068281507ebcef" exitCode=0 Jul 15 22:22:56.123211 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:56.122787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" event={"ID":"6fbaaa2d-c919-4632-8d5c-c1f275fec69e","Type":"ContainerDied","Data":"12eac6de51b75affc10ef2e0a792e20572c8986cfb6e31cb33068281507ebcef"} Jul 15 22:22:56.124822 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:56.124799 2564 generic.go:356] "Generic (PLEG): container finished" podID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerID="50ce180678e923dcde61618d1897b305290f522b93076497eed1ba5ecd422567" exitCode=0 Jul 15 22:22:56.124912 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:56.124877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" event={"ID":"80dab9d1-2dc7-4347-b8fc-8b30327d7631","Type":"ContainerDied","Data":"50ce180678e923dcde61618d1897b305290f522b93076497eed1ba5ecd422567"} Jul 15 22:22:56.126569 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:56.126548 2564 generic.go:356] "Generic (PLEG): container finished" podID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerID="aaf2b3db475e2923313a2123941eada622d565569ce3d798cbce3842a215ce8b" exitCode=0 Jul 15 22:22:56.126734 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:56.126621 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" event={"ID":"131009fc-f0f4-4738-86a2-1b94a8adc343","Type":"ContainerDied","Data":"aaf2b3db475e2923313a2123941eada622d565569ce3d798cbce3842a215ce8b"} Jul 15 22:22:56.128278 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:56.128259 2564 generic.go:356] "Generic (PLEG): container finished" podID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerID="5dabd0dbc869e04c827040f42a51b41c22483d4c0af5c7a5bd34d622d67748f5" exitCode=0 Jul 15 22:22:56.128352 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:56.128316 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" event={"ID":"b49d5582-524e-49af-bbd0-64c5dc0a8904","Type":"ContainerDied","Data":"5dabd0dbc869e04c827040f42a51b41c22483d4c0af5c7a5bd34d622d67748f5"} Jul 15 22:22:57.135503 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.135468 2564 generic.go:356] "Generic (PLEG): container finished" podID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerID="07ac131b136ea20c6278536610704ba2b9ec4ecabc98399a06d0b51c8e95a331" exitCode=0 Jul 15 22:22:57.135883 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.135547 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" event={"ID":"131009fc-f0f4-4738-86a2-1b94a8adc343","Type":"ContainerDied","Data":"07ac131b136ea20c6278536610704ba2b9ec4ecabc98399a06d0b51c8e95a331"} Jul 15 22:22:57.137531 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.137507 2564 generic.go:356] "Generic (PLEG): container finished" podID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerID="7c0d6a4472ee60d7769a8b0e45e0ac4cb25f16f751b3dd1f217901aa4ca5567a" exitCode=0 Jul 15 22:22:57.137638 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.137573 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" event={"ID":"b49d5582-524e-49af-bbd0-64c5dc0a8904","Type":"ContainerDied","Data":"7c0d6a4472ee60d7769a8b0e45e0ac4cb25f16f751b3dd1f217901aa4ca5567a"} Jul 15 22:22:57.272618 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.272597 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:57.297936 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.297908 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:57.335804 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.335780 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-util\") pod \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " Jul 15 22:22:57.335921 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.335883 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-bundle\") pod \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " Jul 15 22:22:57.335921 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.335903 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhw44\" (UniqueName: \"kubernetes.io/projected/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-kube-api-access-bhw44\") pod \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\" (UID: \"6fbaaa2d-c919-4632-8d5c-c1f275fec69e\") " Jul 15 22:22:57.336354 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.336333 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-bundle" (OuterVolumeSpecName: "bundle") pod "6fbaaa2d-c919-4632-8d5c-c1f275fec69e" (UID: "6fbaaa2d-c919-4632-8d5c-c1f275fec69e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:22:57.337961 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.337932 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-kube-api-access-bhw44" (OuterVolumeSpecName: "kube-api-access-bhw44") pod "6fbaaa2d-c919-4632-8d5c-c1f275fec69e" (UID: "6fbaaa2d-c919-4632-8d5c-c1f275fec69e"). InnerVolumeSpecName "kube-api-access-bhw44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:22:57.345379 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.345339 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-util" (OuterVolumeSpecName: "util") pod "6fbaaa2d-c919-4632-8d5c-c1f275fec69e" (UID: "6fbaaa2d-c919-4632-8d5c-c1f275fec69e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:22:57.436279 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.436257 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z26x2\" (UniqueName: \"kubernetes.io/projected/80dab9d1-2dc7-4347-b8fc-8b30327d7631-kube-api-access-z26x2\") pod \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " Jul 15 22:22:57.436382 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.436307 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-bundle\") pod \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " Jul 15 22:22:57.436382 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.436369 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-util\") pod \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\" (UID: \"80dab9d1-2dc7-4347-b8fc-8b30327d7631\") " Jul 15 22:22:57.436539 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.436528 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:57.436609 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.436541 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhw44\" (UniqueName: \"kubernetes.io/projected/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-kube-api-access-bhw44\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:57.436609 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.436550 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6fbaaa2d-c919-4632-8d5c-c1f275fec69e-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:57.436783 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.436760 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-bundle" (OuterVolumeSpecName: "bundle") pod "80dab9d1-2dc7-4347-b8fc-8b30327d7631" (UID: "80dab9d1-2dc7-4347-b8fc-8b30327d7631"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:22:57.438160 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.438143 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80dab9d1-2dc7-4347-b8fc-8b30327d7631-kube-api-access-z26x2" (OuterVolumeSpecName: "kube-api-access-z26x2") pod "80dab9d1-2dc7-4347-b8fc-8b30327d7631" (UID: "80dab9d1-2dc7-4347-b8fc-8b30327d7631"). InnerVolumeSpecName "kube-api-access-z26x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:22:57.444755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.444732 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-util" (OuterVolumeSpecName: "util") pod "80dab9d1-2dc7-4347-b8fc-8b30327d7631" (UID: "80dab9d1-2dc7-4347-b8fc-8b30327d7631"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:22:57.536893 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.536871 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:57.536893 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.536893 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z26x2\" (UniqueName: \"kubernetes.io/projected/80dab9d1-2dc7-4347-b8fc-8b30327d7631-kube-api-access-z26x2\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:57.537023 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:57.536903 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/80dab9d1-2dc7-4347-b8fc-8b30327d7631-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:58.144118 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.144082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" event={"ID":"6fbaaa2d-c919-4632-8d5c-c1f275fec69e","Type":"ContainerDied","Data":"92eafdb92b713fc0c3ac876b560fe51f1f16e224c7096aa8c8afb851059e6f2d"} Jul 15 22:22:58.144537 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.144130 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92eafdb92b713fc0c3ac876b560fe51f1f16e224c7096aa8c8afb851059e6f2d" Jul 15 22:22:58.144537 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.144089 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6" Jul 15 22:22:58.146210 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.146075 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" event={"ID":"80dab9d1-2dc7-4347-b8fc-8b30327d7631","Type":"ContainerDied","Data":"5c1b6ac75c0dae8b7d25d40a80f5dabe53ea8d7e82be2982a84a2c9b83083057"} Jul 15 22:22:58.146210 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.146117 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c1b6ac75c0dae8b7d25d40a80f5dabe53ea8d7e82be2982a84a2c9b83083057" Jul 15 22:22:58.146894 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.146555 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6" Jul 15 22:22:58.299056 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.299037 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:58.301137 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.301122 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:58.444189 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.444110 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-util\") pod \"131009fc-f0f4-4738-86a2-1b94a8adc343\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " Jul 15 22:22:58.444189 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.444167 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xc2pl\" (UniqueName: \"kubernetes.io/projected/131009fc-f0f4-4738-86a2-1b94a8adc343-kube-api-access-xc2pl\") pod \"131009fc-f0f4-4738-86a2-1b94a8adc343\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " Jul 15 22:22:58.444189 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.444189 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-bundle\") pod \"b49d5582-524e-49af-bbd0-64c5dc0a8904\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " Jul 15 22:22:58.444479 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.444215 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-bundle\") pod \"131009fc-f0f4-4738-86a2-1b94a8adc343\" (UID: \"131009fc-f0f4-4738-86a2-1b94a8adc343\") " Jul 15 22:22:58.444479 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.444240 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-util\") pod \"b49d5582-524e-49af-bbd0-64c5dc0a8904\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " Jul 15 22:22:58.444479 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.444260 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rkjz\" (UniqueName: \"kubernetes.io/projected/b49d5582-524e-49af-bbd0-64c5dc0a8904-kube-api-access-6rkjz\") pod \"b49d5582-524e-49af-bbd0-64c5dc0a8904\" (UID: \"b49d5582-524e-49af-bbd0-64c5dc0a8904\") " Jul 15 22:22:58.444767 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.444741 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-bundle" (OuterVolumeSpecName: "bundle") pod "b49d5582-524e-49af-bbd0-64c5dc0a8904" (UID: "b49d5582-524e-49af-bbd0-64c5dc0a8904"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:22:58.446758 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.446726 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131009fc-f0f4-4738-86a2-1b94a8adc343-kube-api-access-xc2pl" (OuterVolumeSpecName: "kube-api-access-xc2pl") pod "131009fc-f0f4-4738-86a2-1b94a8adc343" (UID: "131009fc-f0f4-4738-86a2-1b94a8adc343"). InnerVolumeSpecName "kube-api-access-xc2pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:22:58.446926 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.446886 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-bundle" (OuterVolumeSpecName: "bundle") pod "131009fc-f0f4-4738-86a2-1b94a8adc343" (UID: "131009fc-f0f4-4738-86a2-1b94a8adc343"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:22:58.447127 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.447103 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49d5582-524e-49af-bbd0-64c5dc0a8904-kube-api-access-6rkjz" (OuterVolumeSpecName: "kube-api-access-6rkjz") pod "b49d5582-524e-49af-bbd0-64c5dc0a8904" (UID: "b49d5582-524e-49af-bbd0-64c5dc0a8904"). InnerVolumeSpecName "kube-api-access-6rkjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:22:58.450080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.450057 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-util" (OuterVolumeSpecName: "util") pod "131009fc-f0f4-4738-86a2-1b94a8adc343" (UID: "131009fc-f0f4-4738-86a2-1b94a8adc343"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:22:58.450907 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.450885 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-util" (OuterVolumeSpecName: "util") pod "b49d5582-524e-49af-bbd0-64c5dc0a8904" (UID: "b49d5582-524e-49af-bbd0-64c5dc0a8904"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:22:58.545456 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.545435 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:58.545456 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.545456 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xc2pl\" (UniqueName: \"kubernetes.io/projected/131009fc-f0f4-4738-86a2-1b94a8adc343-kube-api-access-xc2pl\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:58.545573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.545466 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:58.545573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.545474 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131009fc-f0f4-4738-86a2-1b94a8adc343-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:58.545573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.545481 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b49d5582-524e-49af-bbd0-64c5dc0a8904-util\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:58.545573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:58.545489 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rkjz\" (UniqueName: \"kubernetes.io/projected/b49d5582-524e-49af-bbd0-64c5dc0a8904-kube-api-access-6rkjz\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:22:59.153016 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:59.152984 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" Jul 15 22:22:59.153432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:59.152982 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br" event={"ID":"131009fc-f0f4-4738-86a2-1b94a8adc343","Type":"ContainerDied","Data":"c7d9b1ca447e76a3d92531178458e6aee15c7f5e7f8161459d1fb1ab038163be"} Jul 15 22:22:59.153432 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:59.153151 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7d9b1ca447e76a3d92531178458e6aee15c7f5e7f8161459d1fb1ab038163be" Jul 15 22:22:59.154846 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:59.154829 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" Jul 15 22:22:59.154970 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:59.154868 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht" event={"ID":"b49d5582-524e-49af-bbd0-64c5dc0a8904","Type":"ContainerDied","Data":"acc1f18ca1d07231faa19114a74ac9b5fceab4bb2f9c5cf38f94c220263bf6d5"} Jul 15 22:22:59.154970 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:22:59.154912 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acc1f18ca1d07231faa19114a74ac9b5fceab4bb2f9c5cf38f94c220263bf6d5" Jul 15 22:23:09.580554 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580520 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc"] Jul 15 22:23:09.580918 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580883 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerName="pull" Jul 15 22:23:09.580918 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580894 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerName="pull" Jul 15 22:23:09.580918 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580901 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerName="extract" Jul 15 22:23:09.580918 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580906 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerName="extract" Jul 15 22:23:09.580918 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580917 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerName="pull" Jul 15 22:23:09.580918 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580923 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerName="pull" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580930 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerName="util" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580935 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerName="util" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580941 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerName="pull" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580946 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerName="pull" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580954 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerName="util" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580960 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerName="util" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580965 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580970 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580977 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580981 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580988 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerName="pull" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.580993 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerName="pull" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581001 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerName="util" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581005 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerName="util" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581013 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerName="util" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581018 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerName="util" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581023 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581027 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581080 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="131009fc-f0f4-4738-86a2-1b94a8adc343" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581087 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fbaaa2d-c919-4632-8d5c-c1f275fec69e" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581094 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="80dab9d1-2dc7-4347-b8fc-8b30327d7631" containerName="extract" Jul 15 22:23:09.581116 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.581102 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49d5582-524e-49af-bbd0-64c5dc0a8904" containerName="extract" Jul 15 22:23:09.587655 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.587636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" Jul 15 22:23:09.592056 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.592034 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pf8q9\"" Jul 15 22:23:09.604782 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.604760 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc"] Jul 15 22:23:09.731190 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.731159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ptrr\" (UniqueName: \"kubernetes.io/projected/0dc26d5e-d2cc-4f98-b68a-4d4b50620014-kube-api-access-7ptrr\") pod \"authorino-operator-75cc8d5cb7-sfvkc\" (UID: \"0dc26d5e-d2cc-4f98-b68a-4d4b50620014\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" Jul 15 22:23:09.832225 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.832147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ptrr\" (UniqueName: \"kubernetes.io/projected/0dc26d5e-d2cc-4f98-b68a-4d4b50620014-kube-api-access-7ptrr\") pod \"authorino-operator-75cc8d5cb7-sfvkc\" (UID: \"0dc26d5e-d2cc-4f98-b68a-4d4b50620014\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" Jul 15 22:23:09.841479 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.841446 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ptrr\" (UniqueName: \"kubernetes.io/projected/0dc26d5e-d2cc-4f98-b68a-4d4b50620014-kube-api-access-7ptrr\") pod \"authorino-operator-75cc8d5cb7-sfvkc\" (UID: \"0dc26d5e-d2cc-4f98-b68a-4d4b50620014\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" Jul 15 22:23:09.896862 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:09.896828 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" Jul 15 22:23:10.031710 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:10.031687 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc"] Jul 15 22:23:10.033405 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:23:10.033382 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc26d5e_d2cc_4f98_b68a_4d4b50620014.slice/crio-b6d8c16f4ed5a250bc8b8662b7e4db4a527468f1d32d52b8a957539858aaaf3a WatchSource:0}: Error finding container b6d8c16f4ed5a250bc8b8662b7e4db4a527468f1d32d52b8a957539858aaaf3a: Status 404 returned error can't find the container with id b6d8c16f4ed5a250bc8b8662b7e4db4a527468f1d32d52b8a957539858aaaf3a Jul 15 22:23:10.213975 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:10.213946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" event={"ID":"0dc26d5e-d2cc-4f98-b68a-4d4b50620014","Type":"ContainerStarted","Data":"b6d8c16f4ed5a250bc8b8662b7e4db4a527468f1d32d52b8a957539858aaaf3a"} Jul 15 22:23:13.231162 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:13.231127 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" event={"ID":"0dc26d5e-d2cc-4f98-b68a-4d4b50620014","Type":"ContainerStarted","Data":"a4c59fc42469059402e3d2ec75278af74a8e2bba8fc9be8012dea096a59f4862"} Jul 15 22:23:13.231550 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:13.231203 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" Jul 15 22:23:13.288758 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:13.288709 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" podStartSLOduration=2.087079542 podStartE2EDuration="4.288693915s" totalImagesPullingTime="2.201614373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:13.282639062 +0000 UTC m=+408.453296520" watchObservedRunningTime="2026-07-15 22:23:13.288693915 +0000 UTC m=+408.459351414" Jul 15 22:23:19.312257 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.312223 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh"] Jul 15 22:23:19.315414 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.315392 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:19.318592 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.318573 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cjkkx\"" Jul 15 22:23:19.348105 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.348078 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh"] Jul 15 22:23:19.412165 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.412138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slwjg\" (UniqueName: \"kubernetes.io/projected/0ed347e5-8ed1-47bb-8eae-0d0aecc09b63-kube-api-access-slwjg\") pod \"limitador-operator-controller-manager-859d7b78bd-gbbsh\" (UID: \"0ed347e5-8ed1-47bb-8eae-0d0aecc09b63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:19.513306 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.513250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slwjg\" (UniqueName: \"kubernetes.io/projected/0ed347e5-8ed1-47bb-8eae-0d0aecc09b63-kube-api-access-slwjg\") pod \"limitador-operator-controller-manager-859d7b78bd-gbbsh\" (UID: \"0ed347e5-8ed1-47bb-8eae-0d0aecc09b63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:19.527008 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.526975 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slwjg\" (UniqueName: \"kubernetes.io/projected/0ed347e5-8ed1-47bb-8eae-0d0aecc09b63-kube-api-access-slwjg\") pod \"limitador-operator-controller-manager-859d7b78bd-gbbsh\" (UID: \"0ed347e5-8ed1-47bb-8eae-0d0aecc09b63\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:19.624929 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.624856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:19.766110 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:19.766082 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh"] Jul 15 22:23:19.767902 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:23:19.767880 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed347e5_8ed1_47bb_8eae_0d0aecc09b63.slice/crio-aa57a4a8ebc7291e3a08141eda14915a4da824dc979ec091358f8e9cc112f923 WatchSource:0}: Error finding container aa57a4a8ebc7291e3a08141eda14915a4da824dc979ec091358f8e9cc112f923: Status 404 returned error can't find the container with id aa57a4a8ebc7291e3a08141eda14915a4da824dc979ec091358f8e9cc112f923 Jul 15 22:23:20.268937 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:20.268898 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" event={"ID":"0ed347e5-8ed1-47bb-8eae-0d0aecc09b63","Type":"ContainerStarted","Data":"aa57a4a8ebc7291e3a08141eda14915a4da824dc979ec091358f8e9cc112f923"} Jul 15 22:23:22.281785 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:22.281752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" event={"ID":"0ed347e5-8ed1-47bb-8eae-0d0aecc09b63","Type":"ContainerStarted","Data":"efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf"} Jul 15 22:23:22.282156 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:22.281828 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:22.309479 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:22.309430 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" podStartSLOduration=1.600376053 podStartE2EDuration="3.30941525s" totalImagesPullingTime="1.709039197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:22.307243386 +0000 UTC m=+417.477900822" watchObservedRunningTime="2026-07-15 22:23:22.30941525 +0000 UTC m=+417.480072686" Jul 15 22:23:24.238846 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:24.238811 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-sfvkc" Jul 15 22:23:33.290404 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:33.290373 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:37.075137 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.075097 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh"] Jul 15 22:23:37.075540 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.075324 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" podUID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" containerName="manager" containerID="cri-o://efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf" gracePeriod=2 Jul 15 22:23:37.091637 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.091517 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh"] Jul 15 22:23:37.111361 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:23:37.111316 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0ed347e5-8ed1-47bb-8eae-0d0aecc09b63\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-gbbsh\": pods \"limitador-operator-controller-manager-859d7b78bd-gbbsh\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:37.126014 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.125987 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx"] Jul 15 22:23:37.126399 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.126385 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" containerName="manager" Jul 15 22:23:37.126451 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.126401 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" containerName="manager" Jul 15 22:23:37.126491 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.126460 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" containerName="manager" Jul 15 22:23:37.129692 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.129672 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" Jul 15 22:23:37.132747 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:23:37.132713 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbbsh\" is forbidden: User \"system:node:ip-10-0-136-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-87.ec2.internal' and this object" podUID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:37.152255 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.152227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgr78\" (UniqueName: \"kubernetes.io/projected/2efde057-50a4-43dc-8ba5-541c7bfc9464-kube-api-access-qgr78\") pod \"limitador-operator-controller-manager-859d7b78bd-jpcsx\" (UID: \"2efde057-50a4-43dc-8ba5-541c7bfc9464\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" Jul 15 22:23:37.157486 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.157464 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx"] Jul 15 22:23:37.252797 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.252767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgr78\" (UniqueName: \"kubernetes.io/projected/2efde057-50a4-43dc-8ba5-541c7bfc9464-kube-api-access-qgr78\") pod \"limitador-operator-controller-manager-859d7b78bd-jpcsx\" (UID: \"2efde057-50a4-43dc-8ba5-541c7bfc9464\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" Jul 15 22:23:37.274648 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.274614 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgr78\" (UniqueName: \"kubernetes.io/projected/2efde057-50a4-43dc-8ba5-541c7bfc9464-kube-api-access-qgr78\") pod \"limitador-operator-controller-manager-859d7b78bd-jpcsx\" (UID: \"2efde057-50a4-43dc-8ba5-541c7bfc9464\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" Jul 15 22:23:37.310152 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.310131 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:37.312720 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:23:37.312695 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbbsh\" is forbidden: User \"system:node:ip-10-0-136-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-87.ec2.internal' and this object" podUID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:37.353199 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.353130 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slwjg\" (UniqueName: \"kubernetes.io/projected/0ed347e5-8ed1-47bb-8eae-0d0aecc09b63-kube-api-access-slwjg\") pod \"0ed347e5-8ed1-47bb-8eae-0d0aecc09b63\" (UID: \"0ed347e5-8ed1-47bb-8eae-0d0aecc09b63\") " Jul 15 22:23:37.355137 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.355113 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed347e5-8ed1-47bb-8eae-0d0aecc09b63-kube-api-access-slwjg" (OuterVolumeSpecName: "kube-api-access-slwjg") pod "0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" (UID: "0ed347e5-8ed1-47bb-8eae-0d0aecc09b63"). InnerVolumeSpecName "kube-api-access-slwjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:23:37.365949 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.365925 2564 generic.go:356] "Generic (PLEG): container finished" podID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" containerID="efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf" exitCode=0 Jul 15 22:23:37.366071 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.366033 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:37.368570 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:23:37.368540 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbbsh\" is forbidden: User \"system:node:ip-10-0-136-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-87.ec2.internal' and this object" podUID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbbsh" Jul 15 22:23:37.372259 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.372235 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ed347e5-8ed1-47bb-8eae-0d0aecc09b63" path="/var/lib/kubelet/pods/0ed347e5-8ed1-47bb-8eae-0d0aecc09b63/volumes" Jul 15 22:23:37.372722 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.372707 2564 scope.go:117] "RemoveContainer" containerID="efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf" Jul 15 22:23:37.381523 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.381505 2564 scope.go:117] "RemoveContainer" containerID="efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf" Jul 15 22:23:37.381762 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:23:37.381746 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf\": container with ID starting with efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf not found: ID does not exist" containerID="efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf" Jul 15 22:23:37.381810 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.381770 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf"} err="failed to get container status \"efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf\": rpc error: code = NotFound desc = could not find container \"efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf\": container with ID starting with efd9181fe51e6182d39638959b7e31f9d6fa087638aa6b3c86f54a73b5be91bf not found: ID does not exist" Jul 15 22:23:37.454371 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.454332 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slwjg\" (UniqueName: \"kubernetes.io/projected/0ed347e5-8ed1-47bb-8eae-0d0aecc09b63-kube-api-access-slwjg\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:23:37.459220 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.459180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" Jul 15 22:23:37.598209 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:37.598185 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx"] Jul 15 22:23:37.599942 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:23:37.599916 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efde057_50a4_43dc_8ba5_541c7bfc9464.slice/crio-a7dbfd98d85883f1d759ceb5e567e455dce0301cd04b18f67773e1261e7f7cf1 WatchSource:0}: Error finding container a7dbfd98d85883f1d759ceb5e567e455dce0301cd04b18f67773e1261e7f7cf1: Status 404 returned error can't find the container with id a7dbfd98d85883f1d759ceb5e567e455dce0301cd04b18f67773e1261e7f7cf1 Jul 15 22:23:38.373413 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:38.373374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" event={"ID":"2efde057-50a4-43dc-8ba5-541c7bfc9464","Type":"ContainerStarted","Data":"5804bba0aeca0e3d40286ea4676be067dbd6e096e5c293668d647e1830103450"} Jul 15 22:23:38.373791 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:38.373453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" event={"ID":"2efde057-50a4-43dc-8ba5-541c7bfc9464","Type":"ContainerStarted","Data":"a7dbfd98d85883f1d759ceb5e567e455dce0301cd04b18f67773e1261e7f7cf1"} Jul 15 22:23:38.373791 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:38.373520 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" Jul 15 22:23:38.401701 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:38.401652 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" podStartSLOduration=1.401635913 podStartE2EDuration="1.401635913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:38.398506066 +0000 UTC m=+433.569163502" watchObservedRunningTime="2026-07-15 22:23:38.401635913 +0000 UTC m=+433.572293349" Jul 15 22:23:49.380059 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.379982 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jpcsx" Jul 15 22:23:49.786759 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.786679 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7"] Jul 15 22:23:49.790249 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.790223 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:49.793013 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.792994 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8xls\"" Jul 15 22:23:49.804565 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.804546 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7"] Jul 15 22:23:49.864129 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.864100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2c81185-24e5-449f-819e-b4a9957eb8eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9wpj7\" (UID: \"f2c81185-24e5-449f-819e-b4a9957eb8eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:49.864319 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.864150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4dsq\" (UniqueName: \"kubernetes.io/projected/f2c81185-24e5-449f-819e-b4a9957eb8eb-kube-api-access-f4dsq\") pod \"kuadrant-operator-controller-manager-86878c769f-9wpj7\" (UID: \"f2c81185-24e5-449f-819e-b4a9957eb8eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:49.965387 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.965354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2c81185-24e5-449f-819e-b4a9957eb8eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9wpj7\" (UID: \"f2c81185-24e5-449f-819e-b4a9957eb8eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:49.965523 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.965409 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4dsq\" (UniqueName: \"kubernetes.io/projected/f2c81185-24e5-449f-819e-b4a9957eb8eb-kube-api-access-f4dsq\") pod \"kuadrant-operator-controller-manager-86878c769f-9wpj7\" (UID: \"f2c81185-24e5-449f-819e-b4a9957eb8eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:49.965716 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.965699 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2c81185-24e5-449f-819e-b4a9957eb8eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-9wpj7\" (UID: \"f2c81185-24e5-449f-819e-b4a9957eb8eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:49.977186 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:49.977158 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4dsq\" (UniqueName: \"kubernetes.io/projected/f2c81185-24e5-449f-819e-b4a9957eb8eb-kube-api-access-f4dsq\") pod \"kuadrant-operator-controller-manager-86878c769f-9wpj7\" (UID: \"f2c81185-24e5-449f-819e-b4a9957eb8eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:50.100773 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:50.100712 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:50.243932 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:50.243908 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7"] Jul 15 22:23:50.246048 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:23:50.246020 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c81185_24e5_449f_819e_b4a9957eb8eb.slice/crio-b238361571e4c12033fdcc84017e1d6a75eb628b8690e1d1224628cec964e455 WatchSource:0}: Error finding container b238361571e4c12033fdcc84017e1d6a75eb628b8690e1d1224628cec964e455: Status 404 returned error can't find the container with id b238361571e4c12033fdcc84017e1d6a75eb628b8690e1d1224628cec964e455 Jul 15 22:23:50.434619 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:50.434585 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" event={"ID":"f2c81185-24e5-449f-819e-b4a9957eb8eb","Type":"ContainerStarted","Data":"b238361571e4c12033fdcc84017e1d6a75eb628b8690e1d1224628cec964e455"} Jul 15 22:23:55.469497 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:55.469461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" event={"ID":"f2c81185-24e5-449f-819e-b4a9957eb8eb","Type":"ContainerStarted","Data":"4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487"} Jul 15 22:23:55.469952 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:55.469538 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:23:55.494154 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:23:55.494101 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" podStartSLOduration=1.867067104 podStartE2EDuration="6.49408106s" totalImagesPullingTime="4.627013956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:23:55.490627343 +0000 UTC m=+450.661284778" watchObservedRunningTime="2026-07-15 22:23:55.49408106 +0000 UTC m=+450.664738499" Jul 15 22:24:05.463194 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:05.463155 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5688bdcbdb-fpntc"] Jul 15 22:24:06.477343 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:06.477316 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:24:30.483580 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.483518 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5688bdcbdb-fpntc" podUID="a1c5ccdc-b82b-4138-ad2e-9966e6d29396" containerName="console" containerID="cri-o://ac4de4f0b419530f203164c0140dcf5b6728f053fb92d021d5c7518b306122be" gracePeriod=15 Jul 15 22:24:30.655660 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.655628 2564 generic.go:356] "Generic (PLEG): container finished" podID="a1c5ccdc-b82b-4138-ad2e-9966e6d29396" containerID="ac4de4f0b419530f203164c0140dcf5b6728f053fb92d021d5c7518b306122be" exitCode=0 Jul 15 22:24:30.655776 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.655702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5688bdcbdb-fpntc" event={"ID":"a1c5ccdc-b82b-4138-ad2e-9966e6d29396","Type":"ContainerDied","Data":"ac4de4f0b419530f203164c0140dcf5b6728f053fb92d021d5c7518b306122be"} Jul 15 22:24:30.734929 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.734879 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:24:30.808387 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808354 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-config\") pod \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " Jul 15 22:24:30.808547 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808423 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-trusted-ca-bundle\") pod \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " Jul 15 22:24:30.808547 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808490 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-serving-cert\") pod \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " Jul 15 22:24:30.808547 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808523 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-service-ca\") pod \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " Jul 15 22:24:30.808711 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808565 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-oauth-config\") pod \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " Jul 15 22:24:30.808711 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808590 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-oauth-serving-cert\") pod \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " Jul 15 22:24:30.808711 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808619 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd5zz\" (UniqueName: \"kubernetes.io/projected/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-kube-api-access-pd5zz\") pod \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\" (UID: \"a1c5ccdc-b82b-4138-ad2e-9966e6d29396\") " Jul 15 22:24:30.808988 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808948 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-config" (OuterVolumeSpecName: "console-config") pod "a1c5ccdc-b82b-4138-ad2e-9966e6d29396" (UID: "a1c5ccdc-b82b-4138-ad2e-9966e6d29396"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:24:30.809085 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.808982 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a1c5ccdc-b82b-4138-ad2e-9966e6d29396" (UID: "a1c5ccdc-b82b-4138-ad2e-9966e6d29396"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:24:30.809085 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.809036 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-service-ca" (OuterVolumeSpecName: "service-ca") pod "a1c5ccdc-b82b-4138-ad2e-9966e6d29396" (UID: "a1c5ccdc-b82b-4138-ad2e-9966e6d29396"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:24:30.809169 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.809093 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a1c5ccdc-b82b-4138-ad2e-9966e6d29396" (UID: "a1c5ccdc-b82b-4138-ad2e-9966e6d29396"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:24:30.810719 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.810692 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a1c5ccdc-b82b-4138-ad2e-9966e6d29396" (UID: "a1c5ccdc-b82b-4138-ad2e-9966e6d29396"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:24:30.810803 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.810781 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-kube-api-access-pd5zz" (OuterVolumeSpecName: "kube-api-access-pd5zz") pod "a1c5ccdc-b82b-4138-ad2e-9966e6d29396" (UID: "a1c5ccdc-b82b-4138-ad2e-9966e6d29396"). InnerVolumeSpecName "kube-api-access-pd5zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:24:30.810845 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.810802 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a1c5ccdc-b82b-4138-ad2e-9966e6d29396" (UID: "a1c5ccdc-b82b-4138-ad2e-9966e6d29396"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 22:24:30.909378 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.909353 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-serving-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:24:30.909378 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.909375 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-service-ca\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:24:30.909501 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.909384 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-oauth-config\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:24:30.909501 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.909392 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-oauth-serving-cert\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:24:30.909501 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.909401 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd5zz\" (UniqueName: \"kubernetes.io/projected/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-kube-api-access-pd5zz\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:24:30.909501 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.909409 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-console-config\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:24:30.909501 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:30.909417 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1c5ccdc-b82b-4138-ad2e-9966e6d29396-trusted-ca-bundle\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:24:31.663369 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:31.663272 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5688bdcbdb-fpntc" event={"ID":"a1c5ccdc-b82b-4138-ad2e-9966e6d29396","Type":"ContainerDied","Data":"dcbcc84a18a3871d67a18e542c80850909d2355915f552faa971afb629adfe83"} Jul 15 22:24:31.663369 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:31.663316 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5688bdcbdb-fpntc" Jul 15 22:24:31.663369 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:31.663349 2564 scope.go:117] "RemoveContainer" containerID="ac4de4f0b419530f203164c0140dcf5b6728f053fb92d021d5c7518b306122be" Jul 15 22:24:31.693631 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:31.693608 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5688bdcbdb-fpntc"] Jul 15 22:24:31.699159 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:31.699137 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5688bdcbdb-fpntc"] Jul 15 22:24:33.372580 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:24:33.372546 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1c5ccdc-b82b-4138-ad2e-9966e6d29396" path="/var/lib/kubelet/pods/a1c5ccdc-b82b-4138-ad2e-9966e6d29396/volumes" Jul 15 22:26:54.150038 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.149966 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd"] Jul 15 22:26:54.152384 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.150349 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1c5ccdc-b82b-4138-ad2e-9966e6d29396" containerName="console" Jul 15 22:26:54.152384 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.150362 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1c5ccdc-b82b-4138-ad2e-9966e6d29396" containerName="console" Jul 15 22:26:54.152384 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.150421 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1c5ccdc-b82b-4138-ad2e-9966e6d29396" containerName="console" Jul 15 22:26:54.153225 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.153211 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.158353 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.158335 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 22:26:54.158472 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.158335 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 15 22:26:54.158472 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.158335 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tckxd\"" Jul 15 22:26:54.158648 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.158627 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 22:26:54.189716 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.189692 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd"] Jul 15 22:26:54.277088 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.277057 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.277224 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.277109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.277224 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.277176 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.277224 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.277208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.277388 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.277233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk4sx\" (UniqueName: \"kubernetes.io/projected/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-kube-api-access-rk4sx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.277388 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.277254 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.378579 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.378544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.378730 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.378608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.378730 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.378644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.378730 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.378676 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.378730 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.378714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk4sx\" (UniqueName: \"kubernetes.io/projected/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-kube-api-access-rk4sx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.378872 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.378743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.379103 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.379070 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.379225 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.379117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.379225 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.379143 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.380709 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.380687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.381011 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.380995 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.388049 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.388025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk4sx\" (UniqueName: \"kubernetes.io/projected/d947a12b-791c-4f13-a81a-c2d6c8bd99e0-kube-api-access-rk4sx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd\" (UID: \"d947a12b-791c-4f13-a81a-c2d6c8bd99e0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.463393 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.463340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:26:54.593490 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.593468 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd"] Jul 15 22:26:54.595087 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:26:54.595061 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd947a12b_791c_4f13_a81a_c2d6c8bd99e0.slice/crio-ce504129b7b402188bf4b5fe0ffa9dba8f39bc1eb69a54ee78e20f0f860346e0 WatchSource:0}: Error finding container ce504129b7b402188bf4b5fe0ffa9dba8f39bc1eb69a54ee78e20f0f860346e0: Status 404 returned error can't find the container with id ce504129b7b402188bf4b5fe0ffa9dba8f39bc1eb69a54ee78e20f0f860346e0 Jul 15 22:26:54.596306 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:54.596268 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:26:55.423580 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:55.423531 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" event={"ID":"d947a12b-791c-4f13-a81a-c2d6c8bd99e0","Type":"ContainerStarted","Data":"ce504129b7b402188bf4b5fe0ffa9dba8f39bc1eb69a54ee78e20f0f860346e0"} Jul 15 22:26:56.430721 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:56.430687 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" event={"ID":"d947a12b-791c-4f13-a81a-c2d6c8bd99e0","Type":"ContainerStarted","Data":"c1d0db54baf7ae64e0b37bdcdb5b1586930cb80bbfe9268b7c41964ac56757ae"} Jul 15 22:26:56.455180 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:26:56.455135 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" podStartSLOduration=1.452191162 podStartE2EDuration="2.455120557s" totalImagesPullingTime="1.002929395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:26:56.454485649 +0000 UTC m=+631.625143085" watchObservedRunningTime="2026-07-15 22:26:56.455120557 +0000 UTC m=+631.625777993" Jul 15 22:27:04.463790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:04.463752 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:27:04.464242 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:04.463808 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:27:04.476543 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:04.476515 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:27:04.487538 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:04.487507 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd" Jul 15 22:27:08.297442 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.297414 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr"] Jul 15 22:27:08.300914 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.300897 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.303551 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.303531 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 22:27:08.312621 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.312600 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr"] Jul 15 22:27:08.405383 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.405346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.405383 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.405378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.405580 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.405416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.405580 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.405509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/188deca8-472d-42c5-b7d2-a8cb6aeca986-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.405580 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.405540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.405580 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.405563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldwj9\" (UniqueName: \"kubernetes.io/projected/188deca8-472d-42c5-b7d2-a8cb6aeca986-kube-api-access-ldwj9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.506551 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.506523 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/188deca8-472d-42c5-b7d2-a8cb6aeca986-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.506724 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.506556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.506724 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.506578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldwj9\" (UniqueName: \"kubernetes.io/projected/188deca8-472d-42c5-b7d2-a8cb6aeca986-kube-api-access-ldwj9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.506724 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.506630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.506724 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.506645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.506724 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.506668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.507059 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.507034 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.507127 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.507078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.507208 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.507188 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.508877 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.508860 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/188deca8-472d-42c5-b7d2-a8cb6aeca986-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.509258 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.509237 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/188deca8-472d-42c5-b7d2-a8cb6aeca986-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.518241 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.518221 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldwj9\" (UniqueName: \"kubernetes.io/projected/188deca8-472d-42c5-b7d2-a8cb6aeca986-kube-api-access-ldwj9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vwpsr\" (UID: \"188deca8-472d-42c5-b7d2-a8cb6aeca986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.612331 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.612247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:08.745991 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:08.745962 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr"] Jul 15 22:27:08.746995 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:27:08.746972 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188deca8_472d_42c5_b7d2_a8cb6aeca986.slice/crio-ec75174c616260a1d6c1310c5536f95d05bc15e25e209884fe6a65e4c5949138 WatchSource:0}: Error finding container ec75174c616260a1d6c1310c5536f95d05bc15e25e209884fe6a65e4c5949138: Status 404 returned error can't find the container with id ec75174c616260a1d6c1310c5536f95d05bc15e25e209884fe6a65e4c5949138 Jul 15 22:27:09.499549 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:09.499517 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" event={"ID":"188deca8-472d-42c5-b7d2-a8cb6aeca986","Type":"ContainerStarted","Data":"8078cf58e39e30d4a1d6a134ed917c943abe2ad64ddfad79faaa06be5eb3dd47"} Jul 15 22:27:09.499916 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:09.499564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" event={"ID":"188deca8-472d-42c5-b7d2-a8cb6aeca986","Type":"ContainerStarted","Data":"ec75174c616260a1d6c1310c5536f95d05bc15e25e209884fe6a65e4c5949138"} Jul 15 22:27:09.519836 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:09.519789 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" podStartSLOduration=1.338426233 podStartE2EDuration="1.519774815s" totalImagesPullingTime="181.348582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:27:09.517405626 +0000 UTC m=+644.688063062" watchObservedRunningTime="2026-07-15 22:27:09.519774815 +0000 UTC m=+644.690432251" Jul 15 22:27:18.613387 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:18.613350 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:18.613839 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:18.613452 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:18.626045 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:18.626019 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:27:19.564057 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:27:19.564023 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vwpsr" Jul 15 22:34:11.844300 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:11.844257 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7"] Jul 15 22:34:11.846954 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:11.844529 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" podUID="f2c81185-24e5-449f-819e-b4a9957eb8eb" containerName="manager" containerID="cri-o://4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487" gracePeriod=10 Jul 15 22:34:14.395413 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.395391 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:34:14.469911 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.469879 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2c81185-24e5-449f-819e-b4a9957eb8eb-extensions-socket-volume\") pod \"f2c81185-24e5-449f-819e-b4a9957eb8eb\" (UID: \"f2c81185-24e5-449f-819e-b4a9957eb8eb\") " Jul 15 22:34:14.470087 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.469982 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4dsq\" (UniqueName: \"kubernetes.io/projected/f2c81185-24e5-449f-819e-b4a9957eb8eb-kube-api-access-f4dsq\") pod \"f2c81185-24e5-449f-819e-b4a9957eb8eb\" (UID: \"f2c81185-24e5-449f-819e-b4a9957eb8eb\") " Jul 15 22:34:14.470242 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.470212 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2c81185-24e5-449f-819e-b4a9957eb8eb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f2c81185-24e5-449f-819e-b4a9957eb8eb" (UID: "f2c81185-24e5-449f-819e-b4a9957eb8eb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 22:34:14.471954 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.471935 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c81185-24e5-449f-819e-b4a9957eb8eb-kube-api-access-f4dsq" (OuterVolumeSpecName: "kube-api-access-f4dsq") pod "f2c81185-24e5-449f-819e-b4a9957eb8eb" (UID: "f2c81185-24e5-449f-819e-b4a9957eb8eb"). InnerVolumeSpecName "kube-api-access-f4dsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 22:34:14.571214 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.571150 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4dsq\" (UniqueName: \"kubernetes.io/projected/f2c81185-24e5-449f-819e-b4a9957eb8eb-kube-api-access-f4dsq\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:34:14.571214 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.571174 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2c81185-24e5-449f-819e-b4a9957eb8eb-extensions-socket-volume\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:34:14.775393 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.775359 2564 generic.go:356] "Generic (PLEG): container finished" podID="f2c81185-24e5-449f-819e-b4a9957eb8eb" containerID="4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487" exitCode=0 Jul 15 22:34:14.775573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.775410 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" Jul 15 22:34:14.775573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.775448 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" event={"ID":"f2c81185-24e5-449f-819e-b4a9957eb8eb","Type":"ContainerDied","Data":"4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487"} Jul 15 22:34:14.775573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.775535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7" event={"ID":"f2c81185-24e5-449f-819e-b4a9957eb8eb","Type":"ContainerDied","Data":"b238361571e4c12033fdcc84017e1d6a75eb628b8690e1d1224628cec964e455"} Jul 15 22:34:14.775573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.775565 2564 scope.go:117] "RemoveContainer" containerID="4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487" Jul 15 22:34:14.785379 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.785361 2564 scope.go:117] "RemoveContainer" containerID="4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487" Jul 15 22:34:14.785648 ip-10-0-136-87 kubenswrapper[2564]: E0715 22:34:14.785631 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487\": container with ID starting with 4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487 not found: ID does not exist" containerID="4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487" Jul 15 22:34:14.785689 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.785660 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487"} err="failed to get container status \"4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487\": rpc error: code = NotFound desc = could not find container \"4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487\": container with ID starting with 4cc7489c8a58dc7055875fb860743c1e19165637f211c03e6622f176147d0487 not found: ID does not exist" Jul 15 22:34:14.797479 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.797450 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7"] Jul 15 22:34:14.800853 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:14.800832 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-9wpj7"] Jul 15 22:34:15.372445 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:34:15.372411 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c81185-24e5-449f-819e-b4a9957eb8eb" path="/var/lib/kubelet/pods/f2c81185-24e5-449f-819e-b4a9957eb8eb/volumes" Jul 15 22:35:12.959808 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:12.959776 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml"] Jul 15 22:35:12.960253 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:12.960145 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c81185-24e5-449f-819e-b4a9957eb8eb" containerName="manager" Jul 15 22:35:12.960253 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:12.960155 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c81185-24e5-449f-819e-b4a9957eb8eb" containerName="manager" Jul 15 22:35:12.960253 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:12.960210 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c81185-24e5-449f-819e-b4a9957eb8eb" containerName="manager" Jul 15 22:35:12.963152 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:12.963137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:12.966234 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:12.966215 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8xls\"" Jul 15 22:35:12.974607 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:12.974588 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml"] Jul 15 22:35:13.051145 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:13.051116 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3ed90e6-790f-46ba-86fc-42b05b58649d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xtml\" (UID: \"a3ed90e6-790f-46ba-86fc-42b05b58649d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:13.051252 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:13.051180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvq6k\" (UniqueName: \"kubernetes.io/projected/a3ed90e6-790f-46ba-86fc-42b05b58649d-kube-api-access-gvq6k\") pod \"kuadrant-operator-controller-manager-86878c769f-8xtml\" (UID: \"a3ed90e6-790f-46ba-86fc-42b05b58649d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:13.151751 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:13.151715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3ed90e6-790f-46ba-86fc-42b05b58649d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xtml\" (UID: \"a3ed90e6-790f-46ba-86fc-42b05b58649d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:13.151879 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:13.151801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvq6k\" (UniqueName: \"kubernetes.io/projected/a3ed90e6-790f-46ba-86fc-42b05b58649d-kube-api-access-gvq6k\") pod \"kuadrant-operator-controller-manager-86878c769f-8xtml\" (UID: \"a3ed90e6-790f-46ba-86fc-42b05b58649d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:13.152150 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:13.152129 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3ed90e6-790f-46ba-86fc-42b05b58649d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8xtml\" (UID: \"a3ed90e6-790f-46ba-86fc-42b05b58649d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:13.162573 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:13.162552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvq6k\" (UniqueName: \"kubernetes.io/projected/a3ed90e6-790f-46ba-86fc-42b05b58649d-kube-api-access-gvq6k\") pod \"kuadrant-operator-controller-manager-86878c769f-8xtml\" (UID: \"a3ed90e6-790f-46ba-86fc-42b05b58649d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:13.273746 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:13.273671 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:13.413472 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:13.413445 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml"] Jul 15 22:35:13.415000 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:35:13.414975 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ed90e6_790f_46ba_86fc_42b05b58649d.slice/crio-36a4fcf1e6df8d4853d98ea300c22e84e0d4f6ec9404dadfffe2cefd7d9a4cab WatchSource:0}: Error finding container 36a4fcf1e6df8d4853d98ea300c22e84e0d4f6ec9404dadfffe2cefd7d9a4cab: Status 404 returned error can't find the container with id 36a4fcf1e6df8d4853d98ea300c22e84e0d4f6ec9404dadfffe2cefd7d9a4cab Jul 15 22:35:14.080780 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:14.080743 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" event={"ID":"a3ed90e6-790f-46ba-86fc-42b05b58649d","Type":"ContainerStarted","Data":"d584c7ac3d29df25bddb4a8ef80228ee55242d2a38d7252bb7fceba888573de3"} Jul 15 22:35:14.081218 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:14.080887 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:35:14.081218 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:14.080927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" event={"ID":"a3ed90e6-790f-46ba-86fc-42b05b58649d","Type":"ContainerStarted","Data":"36a4fcf1e6df8d4853d98ea300c22e84e0d4f6ec9404dadfffe2cefd7d9a4cab"} Jul 15 22:35:14.103387 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:14.103344 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" podStartSLOduration=2.103332121 podStartE2EDuration="2.103332121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:35:14.100507228 +0000 UTC m=+1129.271164665" watchObservedRunningTime="2026-07-15 22:35:14.103332121 +0000 UTC m=+1129.273989577" Jul 15 22:35:25.088550 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:35:25.088516 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8xtml" Jul 15 22:41:39.418730 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.418698 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9"] Jul 15 22:41:39.422135 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.422118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" Jul 15 22:41:39.424846 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.424824 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 22:41:39.424846 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.424839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\"" Jul 15 22:41:39.430997 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.430974 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9"] Jul 15 22:41:39.516043 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.516003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea936818-0e6f-4b41-b949-d85ff0201828-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0965552-zzgb9\" (UID: \"ea936818-0e6f-4b41-b949-d85ff0201828\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" Jul 15 22:41:39.616539 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.616496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea936818-0e6f-4b41-b949-d85ff0201828-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0965552-zzgb9\" (UID: \"ea936818-0e6f-4b41-b949-d85ff0201828\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" Jul 15 22:41:39.617106 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.617085 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea936818-0e6f-4b41-b949-d85ff0201828-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a0965552-zzgb9\" (UID: \"ea936818-0e6f-4b41-b949-d85ff0201828\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" Jul 15 22:41:39.733174 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.733088 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" Jul 15 22:41:39.868690 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.868665 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9"] Jul 15 22:41:39.870607 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:41:39.870583 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea936818_0e6f_4b41_b949_d85ff0201828.slice/crio-44584c00bb92301f1a5ce0da8f8af6ff8974da2da525d006da670ff0da6787f1 WatchSource:0}: Error finding container 44584c00bb92301f1a5ce0da8f8af6ff8974da2da525d006da670ff0da6787f1: Status 404 returned error can't find the container with id 44584c00bb92301f1a5ce0da8f8af6ff8974da2da525d006da670ff0da6787f1 Jul 15 22:41:39.872842 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:39.872826 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 22:41:40.140979 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:40.140944 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" event={"ID":"ea936818-0e6f-4b41-b949-d85ff0201828","Type":"ContainerStarted","Data":"44584c00bb92301f1a5ce0da8f8af6ff8974da2da525d006da670ff0da6787f1"} Jul 15 22:41:43.159939 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:43.159905 2564 generic.go:356] "Generic (PLEG): container finished" podID="ea936818-0e6f-4b41-b949-d85ff0201828" containerID="c9fc7b92bc5860c728c77afccc710ac905f9d85023032e5654a75e0322623e14" exitCode=7 Jul 15 22:41:43.160445 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:43.159960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" event={"ID":"ea936818-0e6f-4b41-b949-d85ff0201828","Type":"ContainerDied","Data":"c9fc7b92bc5860c728c77afccc710ac905f9d85023032e5654a75e0322623e14"} Jul 15 22:41:43.160445 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:43.160191 2564 scope.go:117] "RemoveContainer" containerID="c9fc7b92bc5860c728c77afccc710ac905f9d85023032e5654a75e0322623e14" Jul 15 22:41:44.167093 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:44.167060 2564 generic.go:356] "Generic (PLEG): container finished" podID="ea936818-0e6f-4b41-b949-d85ff0201828" containerID="b6228707c326a1698814662a711a9871a6650f71feaa65d3c2f2806b08e128d4" exitCode=0 Jul 15 22:41:44.167506 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:44.167128 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" event={"ID":"ea936818-0e6f-4b41-b949-d85ff0201828","Type":"ContainerDied","Data":"b6228707c326a1698814662a711a9871a6650f71feaa65d3c2f2806b08e128d4"} Jul 15 22:41:44.167506 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:44.167171 2564 scope.go:117] "RemoveContainer" containerID="c9fc7b92bc5860c728c77afccc710ac905f9d85023032e5654a75e0322623e14" Jul 15 22:41:45.311788 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:45.311760 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" Jul 15 22:41:45.470602 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:45.470510 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea936818-0e6f-4b41-b949-d85ff0201828-maas-api-service-ca\") pod \"ea936818-0e6f-4b41-b949-d85ff0201828\" (UID: \"ea936818-0e6f-4b41-b949-d85ff0201828\") " Jul 15 22:41:45.470906 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:45.470885 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea936818-0e6f-4b41-b949-d85ff0201828-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ea936818-0e6f-4b41-b949-d85ff0201828" (UID: "ea936818-0e6f-4b41-b949-d85ff0201828"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:41:45.572250 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:45.572215 2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea936818-0e6f-4b41-b949-d85ff0201828-maas-api-service-ca\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:41:46.180608 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:46.180582 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" Jul 15 22:41:46.180790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:46.180612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a0965552-zzgb9" event={"ID":"ea936818-0e6f-4b41-b949-d85ff0201828","Type":"ContainerDied","Data":"44584c00bb92301f1a5ce0da8f8af6ff8974da2da525d006da670ff0da6787f1"} Jul 15 22:41:46.180790 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:41:46.180665 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44584c00bb92301f1a5ce0da8f8af6ff8974da2da525d006da670ff0da6787f1" Jul 15 22:52:40.740480 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.740391 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c"] Jul 15 22:52:40.741046 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.740756 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea936818-0e6f-4b41-b949-d85ff0201828" containerName="revoke-keys" Jul 15 22:52:40.741046 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.740766 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea936818-0e6f-4b41-b949-d85ff0201828" containerName="revoke-keys" Jul 15 22:52:40.741046 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.740793 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea936818-0e6f-4b41-b949-d85ff0201828" containerName="revoke-keys" Jul 15 22:52:40.741046 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.740798 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea936818-0e6f-4b41-b949-d85ff0201828" containerName="revoke-keys" Jul 15 22:52:40.741046 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.740851 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea936818-0e6f-4b41-b949-d85ff0201828" containerName="revoke-keys" Jul 15 22:52:40.741046 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.740858 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea936818-0e6f-4b41-b949-d85ff0201828" containerName="revoke-keys" Jul 15 22:52:40.743917 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.743899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" Jul 15 22:52:40.746665 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.746644 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 22:52:40.746755 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.746691 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\"" Jul 15 22:52:40.750419 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.750396 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c"] Jul 15 22:52:40.877637 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.877606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e80c61a8-9d6b-4140-ae34-e92420d168c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c\" (UID: \"e80c61a8-9d6b-4140-ae34-e92420d168c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" Jul 15 22:52:40.978326 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.978266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e80c61a8-9d6b-4140-ae34-e92420d168c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c\" (UID: \"e80c61a8-9d6b-4140-ae34-e92420d168c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" Jul 15 22:52:40.978930 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:40.978904 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e80c61a8-9d6b-4140-ae34-e92420d168c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c\" (UID: \"e80c61a8-9d6b-4140-ae34-e92420d168c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" Jul 15 22:52:41.055664 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:41.055564 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" Jul 15 22:52:41.195404 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:41.195374 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c"] Jul 15 22:52:41.196227 ip-10-0-136-87 kubenswrapper[2564]: W0715 22:52:41.196202 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80c61a8_9d6b_4140_ae34_e92420d168c9.slice/crio-598838365db306f2ed376940b566f95c7e69465c45e04491a86bbc23acbd6d02 WatchSource:0}: Error finding container 598838365db306f2ed376940b566f95c7e69465c45e04491a86bbc23acbd6d02: Status 404 returned error can't find the container with id 598838365db306f2ed376940b566f95c7e69465c45e04491a86bbc23acbd6d02 Jul 15 22:52:41.728457 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:41.728421 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" event={"ID":"e80c61a8-9d6b-4140-ae34-e92420d168c9","Type":"ContainerStarted","Data":"48bb47b5e50a3ce346319914d543d311a3d73239513ae27cc88bdff07a198c03"} Jul 15 22:52:41.728639 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:41.728481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" event={"ID":"e80c61a8-9d6b-4140-ae34-e92420d168c9","Type":"ContainerStarted","Data":"598838365db306f2ed376940b566f95c7e69465c45e04491a86bbc23acbd6d02"} Jul 15 22:52:41.745806 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:41.745750 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" podStartSLOduration=1.745735934 podStartE2EDuration="1.745735934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 22:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 22:52:41.743891238 +0000 UTC m=+2176.914548674" watchObservedRunningTime="2026-07-15 22:52:41.745735934 +0000 UTC m=+2176.916393369" Jul 15 22:52:42.735905 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:42.735867 2564 generic.go:356] "Generic (PLEG): container finished" podID="e80c61a8-9d6b-4140-ae34-e92420d168c9" containerID="48bb47b5e50a3ce346319914d543d311a3d73239513ae27cc88bdff07a198c03" exitCode=0 Jul 15 22:52:42.736080 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:42.735942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" event={"ID":"e80c61a8-9d6b-4140-ae34-e92420d168c9","Type":"ContainerDied","Data":"48bb47b5e50a3ce346319914d543d311a3d73239513ae27cc88bdff07a198c03"} Jul 15 22:52:43.870041 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:43.870015 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" Jul 15 22:52:44.007411 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:44.007306 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e80c61a8-9d6b-4140-ae34-e92420d168c9-maas-api-service-ca\") pod \"e80c61a8-9d6b-4140-ae34-e92420d168c9\" (UID: \"e80c61a8-9d6b-4140-ae34-e92420d168c9\") " Jul 15 22:52:44.007739 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:44.007704 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e80c61a8-9d6b-4140-ae34-e92420d168c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e80c61a8-9d6b-4140-ae34-e92420d168c9" (UID: "e80c61a8-9d6b-4140-ae34-e92420d168c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 22:52:44.108834 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:44.108797 2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e80c61a8-9d6b-4140-ae34-e92420d168c9-maas-api-service-ca\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 22:52:44.748704 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:44.748673 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" Jul 15 22:52:44.748904 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:44.748710 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c" event={"ID":"e80c61a8-9d6b-4140-ae34-e92420d168c9","Type":"ContainerDied","Data":"598838365db306f2ed376940b566f95c7e69465c45e04491a86bbc23acbd6d02"} Jul 15 22:52:44.748904 ip-10-0-136-87 kubenswrapper[2564]: I0715 22:52:44.748755 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="598838365db306f2ed376940b566f95c7e69465c45e04491a86bbc23acbd6d02" Jul 15 23:00:00.195560 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.195531 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp"] Jul 15 23:00:00.196129 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.196108 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80c61a8-9d6b-4140-ae34-e92420d168c9" containerName="revoke-keys" Jul 15 23:00:00.196214 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.196133 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80c61a8-9d6b-4140-ae34-e92420d168c9" containerName="revoke-keys" Jul 15 23:00:00.196271 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.196248 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80c61a8-9d6b-4140-ae34-e92420d168c9" containerName="revoke-keys" Jul 15 23:00:00.199409 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.199388 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" Jul 15 23:00:00.202593 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.202571 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7wbfz\"" Jul 15 23:00:00.209029 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.209011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" Jul 15 23:00:00.217740 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.217720 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8"] Jul 15 23:00:00.221347 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.221330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" Jul 15 23:00:00.241832 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.241799 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8"] Jul 15 23:00:00.244660 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.244630 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d"] Jul 15 23:00:00.248953 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.248934 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" Jul 15 23:00:00.249768 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.249753 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" Jul 15 23:00:00.260792 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.260767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d"] Jul 15 23:00:00.261892 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.261873 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" Jul 15 23:00:00.271000 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.270958 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp"] Jul 15 23:00:00.405147 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.405124 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp"] Jul 15 23:00:00.405249 ip-10-0-136-87 kubenswrapper[2564]: W0715 23:00:00.405125 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06aeb106_cf0f_42c4_b91a_900629d6eb84.slice/crio-4f53c90819adb4722f80a1a307d761c0bfcc901ddae3353844e5b6a715e4b611 WatchSource:0}: Error finding container 4f53c90819adb4722f80a1a307d761c0bfcc901ddae3353844e5b6a715e4b611: Status 404 returned error can't find the container with id 4f53c90819adb4722f80a1a307d761c0bfcc901ddae3353844e5b6a715e4b611 Jul 15 23:00:00.461372 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.461347 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d"] Jul 15 23:00:00.461966 ip-10-0-136-87 kubenswrapper[2564]: W0715 23:00:00.461945 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5088f046_4413_46a4_a5f6_a0d531177de2.slice/crio-08b3c2617b3b20b09d6d865382153d7e2da013dc854477388aff1a7e4d02791a WatchSource:0}: Error finding container 08b3c2617b3b20b09d6d865382153d7e2da013dc854477388aff1a7e4d02791a: Status 404 returned error can't find the container with id 08b3c2617b3b20b09d6d865382153d7e2da013dc854477388aff1a7e4d02791a Jul 15 23:00:00.646876 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:00.646850 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8"] Jul 15 23:00:00.648581 ip-10-0-136-87 kubenswrapper[2564]: W0715 23:00:00.648559 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee933881_9cb5_4b3d_acdb_dd1c111dfea7.slice/crio-758f5087e5dbbcfa25cab917e55353a153c092241729bbe6b785bad248c6578f WatchSource:0}: Error finding container 758f5087e5dbbcfa25cab917e55353a153c092241729bbe6b785bad248c6578f: Status 404 returned error can't find the container with id 758f5087e5dbbcfa25cab917e55353a153c092241729bbe6b785bad248c6578f Jul 15 23:00:01.116005 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.115916 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" event={"ID":"5088f046-4413-46a4-a5f6-a0d531177de2","Type":"ContainerStarted","Data":"9455a6c70cc66baff356a1b2f6e710c9b630fdcf09c40f7eb59dfcd8640e27f6"} Jul 15 23:00:01.116005 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.115973 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" event={"ID":"5088f046-4413-46a4-a5f6-a0d531177de2","Type":"ContainerStarted","Data":"08b3c2617b3b20b09d6d865382153d7e2da013dc854477388aff1a7e4d02791a"} Jul 15 23:00:01.117475 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.117447 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" event={"ID":"ee933881-9cb5-4b3d-acdb-dd1c111dfea7","Type":"ContainerStarted","Data":"195ca1d711ecefd70d414303532426904e7dee5156747819054b60dfd76a6b7a"} Jul 15 23:00:01.117610 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.117496 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" event={"ID":"ee933881-9cb5-4b3d-acdb-dd1c111dfea7","Type":"ContainerStarted","Data":"758f5087e5dbbcfa25cab917e55353a153c092241729bbe6b785bad248c6578f"} Jul 15 23:00:01.118932 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.118910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" event={"ID":"06aeb106-cf0f-42c4-b91a-900629d6eb84","Type":"ContainerStarted","Data":"0c84702557230b0725757ee3c48f75951e767a610b2807f2f286bc79ff8f5448"} Jul 15 23:00:01.119033 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.118943 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" event={"ID":"06aeb106-cf0f-42c4-b91a-900629d6eb84","Type":"ContainerStarted","Data":"4f53c90819adb4722f80a1a307d761c0bfcc901ddae3353844e5b6a715e4b611"} Jul 15 23:00:01.145124 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.145070 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" podStartSLOduration=1.14505594 podStartE2EDuration="1.14505594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:00:01.141404217 +0000 UTC m=+2616.312061653" watchObservedRunningTime="2026-07-15 23:00:01.14505594 +0000 UTC m=+2616.315713377" Jul 15 23:00:01.223116 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.223068 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" podStartSLOduration=1.223054488 podStartE2EDuration="1.223054488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:00:01.186536949 +0000 UTC m=+2616.357194385" watchObservedRunningTime="2026-07-15 23:00:01.223054488 +0000 UTC m=+2616.393711924" Jul 15 23:00:01.224490 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:01.224461 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" podStartSLOduration=1.224449281 podStartE2EDuration="1.224449281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 23:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:00:01.222119588 +0000 UTC m=+2616.392777025" watchObservedRunningTime="2026-07-15 23:00:01.224449281 +0000 UTC m=+2616.395106718" Jul 15 23:00:02.129419 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:02.129380 2564 generic.go:356] "Generic (PLEG): container finished" podID="5088f046-4413-46a4-a5f6-a0d531177de2" containerID="9455a6c70cc66baff356a1b2f6e710c9b630fdcf09c40f7eb59dfcd8640e27f6" exitCode=0 Jul 15 23:00:02.129560 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:02.129466 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" event={"ID":"5088f046-4413-46a4-a5f6-a0d531177de2","Type":"ContainerDied","Data":"9455a6c70cc66baff356a1b2f6e710c9b630fdcf09c40f7eb59dfcd8640e27f6"} Jul 15 23:00:02.130835 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:02.130814 2564 generic.go:356] "Generic (PLEG): container finished" podID="ee933881-9cb5-4b3d-acdb-dd1c111dfea7" containerID="195ca1d711ecefd70d414303532426904e7dee5156747819054b60dfd76a6b7a" exitCode=0 Jul 15 23:00:02.130954 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:02.130897 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" event={"ID":"ee933881-9cb5-4b3d-acdb-dd1c111dfea7","Type":"ContainerDied","Data":"195ca1d711ecefd70d414303532426904e7dee5156747819054b60dfd76a6b7a"} Jul 15 23:00:02.132222 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:02.132203 2564 generic.go:356] "Generic (PLEG): container finished" podID="06aeb106-cf0f-42c4-b91a-900629d6eb84" containerID="0c84702557230b0725757ee3c48f75951e767a610b2807f2f286bc79ff8f5448" exitCode=0 Jul 15 23:00:02.132319 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:02.132228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" event={"ID":"06aeb106-cf0f-42c4-b91a-900629d6eb84","Type":"ContainerDied","Data":"0c84702557230b0725757ee3c48f75951e767a610b2807f2f286bc79ff8f5448"} Jul 15 23:00:03.278124 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:03.278096 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" Jul 15 23:00:03.307198 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:03.307173 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" Jul 15 23:00:03.340369 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:03.340341 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" Jul 15 23:00:04.146856 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.146819 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" Jul 15 23:00:04.146856 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.146829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp" event={"ID":"06aeb106-cf0f-42c4-b91a-900629d6eb84","Type":"ContainerDied","Data":"4f53c90819adb4722f80a1a307d761c0bfcc901ddae3353844e5b6a715e4b611"} Jul 15 23:00:04.147058 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.146908 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f53c90819adb4722f80a1a307d761c0bfcc901ddae3353844e5b6a715e4b611" Jul 15 23:00:04.148199 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.148182 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" Jul 15 23:00:04.148322 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.148214 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735940-5bq7d" event={"ID":"5088f046-4413-46a4-a5f6-a0d531177de2","Type":"ContainerDied","Data":"08b3c2617b3b20b09d6d865382153d7e2da013dc854477388aff1a7e4d02791a"} Jul 15 23:00:04.148322 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.148262 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08b3c2617b3b20b09d6d865382153d7e2da013dc854477388aff1a7e4d02791a" Jul 15 23:00:04.149521 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.149504 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" Jul 15 23:00:04.149601 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.149505 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8" event={"ID":"ee933881-9cb5-4b3d-acdb-dd1c111dfea7","Type":"ContainerDied","Data":"758f5087e5dbbcfa25cab917e55353a153c092241729bbe6b785bad248c6578f"} Jul 15 23:00:04.149643 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:04.149611 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="758f5087e5dbbcfa25cab917e55353a153c092241729bbe6b785bad248c6578f" Jul 15 23:00:06.843620 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.843588 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7900-140265321561136"] Jul 15 23:00:06.844000 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.843980 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06aeb106-cf0f-42c4-b91a-900629d6eb84" containerName="cleanup" Jul 15 23:00:06.844000 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.843992 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="06aeb106-cf0f-42c4-b91a-900629d6eb84" containerName="cleanup" Jul 15 23:00:06.844077 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.844007 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5088f046-4413-46a4-a5f6-a0d531177de2" containerName="cleanup" Jul 15 23:00:06.844077 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.844013 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5088f046-4413-46a4-a5f6-a0d531177de2" containerName="cleanup" Jul 15 23:00:06.844077 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.844026 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee933881-9cb5-4b3d-acdb-dd1c111dfea7" containerName="cleanup" Jul 15 23:00:06.844077 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.844032 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee933881-9cb5-4b3d-acdb-dd1c111dfea7" containerName="cleanup" Jul 15 23:00:06.844192 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.844088 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee933881-9cb5-4b3d-acdb-dd1c111dfea7" containerName="cleanup" Jul 15 23:00:06.844192 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.844098 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="06aeb106-cf0f-42c4-b91a-900629d6eb84" containerName="cleanup" Jul 15 23:00:06.844192 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.844105 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5088f046-4413-46a4-a5f6-a0d531177de2" containerName="cleanup" Jul 15 23:00:06.847513 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.847495 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321561136" Jul 15 23:00:06.851205 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.851186 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4l7xt\"" Jul 15 23:00:06.860980 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.860959 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321561136"] Jul 15 23:00:06.946170 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:06.946140 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9crp4\" (UniqueName: \"kubernetes.io/projected/704465b7-d0bb-4149-abb3-418302de8cf9-kube-api-access-9crp4\") pod \"test-curl-7900-140265321561136\" (UID: \"704465b7-d0bb-4149-abb3-418302de8cf9\") " pod="opendatahub/test-curl-7900-140265321561136" Jul 15 23:00:07.047038 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:07.047002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9crp4\" (UniqueName: \"kubernetes.io/projected/704465b7-d0bb-4149-abb3-418302de8cf9-kube-api-access-9crp4\") pod \"test-curl-7900-140265321561136\" (UID: \"704465b7-d0bb-4149-abb3-418302de8cf9\") " pod="opendatahub/test-curl-7900-140265321561136" Jul 15 23:00:07.056887 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:07.056858 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9crp4\" (UniqueName: \"kubernetes.io/projected/704465b7-d0bb-4149-abb3-418302de8cf9-kube-api-access-9crp4\") pod \"test-curl-7900-140265321561136\" (UID: \"704465b7-d0bb-4149-abb3-418302de8cf9\") " pod="opendatahub/test-curl-7900-140265321561136" Jul 15 23:00:07.157375 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:07.157344 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321561136" Jul 15 23:00:07.303651 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:07.303622 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321561136"] Jul 15 23:00:07.305527 ip-10-0-136-87 kubenswrapper[2564]: W0715 23:00:07.305497 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod704465b7_d0bb_4149_abb3_418302de8cf9.slice/crio-4a1c59ec888c7859a9bf893ff69732cfa09e28960e780c58f344742beca02a77 WatchSource:0}: Error finding container 4a1c59ec888c7859a9bf893ff69732cfa09e28960e780c58f344742beca02a77: Status 404 returned error can't find the container with id 4a1c59ec888c7859a9bf893ff69732cfa09e28960e780c58f344742beca02a77 Jul 15 23:00:07.306945 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:07.306929 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 23:00:08.185752 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:08.185706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321561136" event={"ID":"704465b7-d0bb-4149-abb3-418302de8cf9","Type":"ContainerStarted","Data":"4a1c59ec888c7859a9bf893ff69732cfa09e28960e780c58f344742beca02a77"} Jul 15 23:00:09.193085 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:09.193048 2564 generic.go:356] "Generic (PLEG): container finished" podID="704465b7-d0bb-4149-abb3-418302de8cf9" containerID="48363f3b5a0eefce387f41459f775fdc7a592983c0865ad6205413fa70560038" exitCode=0 Jul 15 23:00:09.193481 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:09.193116 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321561136" event={"ID":"704465b7-d0bb-4149-abb3-418302de8cf9","Type":"ContainerDied","Data":"48363f3b5a0eefce387f41459f775fdc7a592983c0865ad6205413fa70560038"} Jul 15 23:00:10.331784 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:10.331761 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321561136" Jul 15 23:00:10.388864 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:10.388835 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7900-140265321561136_704465b7-d0bb-4149-abb3-418302de8cf9/test-curl-7900-140265321561136/0.log" Jul 15 23:00:10.421568 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:10.421537 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7900-140265321561136"] Jul 15 23:00:10.423791 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:10.423770 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7900-140265321561136"] Jul 15 23:00:10.481830 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:10.481745 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9crp4\" (UniqueName: \"kubernetes.io/projected/704465b7-d0bb-4149-abb3-418302de8cf9-kube-api-access-9crp4\") pod \"704465b7-d0bb-4149-abb3-418302de8cf9\" (UID: \"704465b7-d0bb-4149-abb3-418302de8cf9\") " Jul 15 23:00:10.483870 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:10.483840 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/704465b7-d0bb-4149-abb3-418302de8cf9-kube-api-access-9crp4" (OuterVolumeSpecName: "kube-api-access-9crp4") pod "704465b7-d0bb-4149-abb3-418302de8cf9" (UID: "704465b7-d0bb-4149-abb3-418302de8cf9"). InnerVolumeSpecName "kube-api-access-9crp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:00:10.583005 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:10.582973 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9crp4\" (UniqueName: \"kubernetes.io/projected/704465b7-d0bb-4149-abb3-418302de8cf9-kube-api-access-9crp4\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 23:00:11.205109 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:11.205081 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a1c59ec888c7859a9bf893ff69732cfa09e28960e780c58f344742beca02a77" Jul 15 23:00:11.205109 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:11.205109 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321561136" Jul 15 23:00:11.214839 ip-10-0-136-87 kubenswrapper[2564]: E0715 23:00:11.214811 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7900-140265321561136\" is forbidden: User \"system:node:ip-10-0-136-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-87.ec2.internal' and this object" podUID="704465b7-d0bb-4149-abb3-418302de8cf9" pod="opendatahub/test-curl-7900-140265321561136" Jul 15 23:00:11.372141 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:11.372111 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="704465b7-d0bb-4149-abb3-418302de8cf9" path="/var/lib/kubelet/pods/704465b7-d0bb-4149-abb3-418302de8cf9/volumes" Jul 15 23:00:20.025525 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.025484 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7900-140265321636896"] Jul 15 23:00:20.026061 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.026041 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="704465b7-d0bb-4149-abb3-418302de8cf9" containerName="test-curl-7900-140265321561136" Jul 15 23:00:20.026130 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.026064 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="704465b7-d0bb-4149-abb3-418302de8cf9" containerName="test-curl-7900-140265321561136" Jul 15 23:00:20.026218 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.026205 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="704465b7-d0bb-4149-abb3-418302de8cf9" containerName="test-curl-7900-140265321561136" Jul 15 23:00:20.029471 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.029450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321636896" Jul 15 23:00:20.032670 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.032647 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4l7xt\"" Jul 15 23:00:20.036021 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.035997 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321636896"] Jul 15 23:00:20.060704 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.060672 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs2qk\" (UniqueName: \"kubernetes.io/projected/863033ed-576b-4a44-bf3f-cb0e62d27843-kube-api-access-hs2qk\") pod \"test-curl-7900-140265321636896\" (UID: \"863033ed-576b-4a44-bf3f-cb0e62d27843\") " pod="opendatahub/test-curl-7900-140265321636896" Jul 15 23:00:20.161299 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.161260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs2qk\" (UniqueName: \"kubernetes.io/projected/863033ed-576b-4a44-bf3f-cb0e62d27843-kube-api-access-hs2qk\") pod \"test-curl-7900-140265321636896\" (UID: \"863033ed-576b-4a44-bf3f-cb0e62d27843\") " pod="opendatahub/test-curl-7900-140265321636896" Jul 15 23:00:20.170326 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.170294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs2qk\" (UniqueName: \"kubernetes.io/projected/863033ed-576b-4a44-bf3f-cb0e62d27843-kube-api-access-hs2qk\") pod \"test-curl-7900-140265321636896\" (UID: \"863033ed-576b-4a44-bf3f-cb0e62d27843\") " pod="opendatahub/test-curl-7900-140265321636896" Jul 15 23:00:20.340736 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.340642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321636896" Jul 15 23:00:20.495104 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:20.495078 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7900-140265321636896"] Jul 15 23:00:20.496941 ip-10-0-136-87 kubenswrapper[2564]: W0715 23:00:20.496914 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod863033ed_576b_4a44_bf3f_cb0e62d27843.slice/crio-e55cf1125a02c93743c7bdfdf4d5a5084394acb4ded98ecb38f38e7f049a6a76 WatchSource:0}: Error finding container e55cf1125a02c93743c7bdfdf4d5a5084394acb4ded98ecb38f38e7f049a6a76: Status 404 returned error can't find the container with id e55cf1125a02c93743c7bdfdf4d5a5084394acb4ded98ecb38f38e7f049a6a76 Jul 15 23:00:21.275976 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:21.275884 2564 generic.go:356] "Generic (PLEG): container finished" podID="863033ed-576b-4a44-bf3f-cb0e62d27843" containerID="84f27a534d8376ffb6db989616e9599d69679b90753959831b0fe550e6e29976" exitCode=0 Jul 15 23:00:21.276341 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:21.275958 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321636896" event={"ID":"863033ed-576b-4a44-bf3f-cb0e62d27843","Type":"ContainerDied","Data":"84f27a534d8376ffb6db989616e9599d69679b90753959831b0fe550e6e29976"} Jul 15 23:00:21.276341 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:21.276007 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7900-140265321636896" event={"ID":"863033ed-576b-4a44-bf3f-cb0e62d27843","Type":"ContainerStarted","Data":"e55cf1125a02c93743c7bdfdf4d5a5084394acb4ded98ecb38f38e7f049a6a76"} Jul 15 23:00:22.420563 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:22.420537 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321636896" Jul 15 23:00:22.444660 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:22.444629 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7900-140265321636896_863033ed-576b-4a44-bf3f-cb0e62d27843/test-curl-7900-140265321636896/0.log" Jul 15 23:00:22.471976 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:22.471936 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7900-140265321636896"] Jul 15 23:00:22.475730 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:22.475706 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7900-140265321636896"] Jul 15 23:00:22.479628 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:22.479611 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs2qk\" (UniqueName: \"kubernetes.io/projected/863033ed-576b-4a44-bf3f-cb0e62d27843-kube-api-access-hs2qk\") pod \"863033ed-576b-4a44-bf3f-cb0e62d27843\" (UID: \"863033ed-576b-4a44-bf3f-cb0e62d27843\") " Jul 15 23:00:22.481656 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:22.481627 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/863033ed-576b-4a44-bf3f-cb0e62d27843-kube-api-access-hs2qk" (OuterVolumeSpecName: "kube-api-access-hs2qk") pod "863033ed-576b-4a44-bf3f-cb0e62d27843" (UID: "863033ed-576b-4a44-bf3f-cb0e62d27843"). InnerVolumeSpecName "kube-api-access-hs2qk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 23:00:22.580989 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:22.580903 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs2qk\" (UniqueName: \"kubernetes.io/projected/863033ed-576b-4a44-bf3f-cb0e62d27843-kube-api-access-hs2qk\") on node \"ip-10-0-136-87.ec2.internal\" DevicePath \"\"" Jul 15 23:00:23.288866 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:23.288838 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7900-140265321636896" Jul 15 23:00:23.288866 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:23.288866 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e55cf1125a02c93743c7bdfdf4d5a5084394acb4ded98ecb38f38e7f049a6a76" Jul 15 23:00:23.298479 ip-10-0-136-87 kubenswrapper[2564]: E0715 23:00:23.298449 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7900-140265321636896\" is forbidden: User \"system:node:ip-10-0-136-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-87.ec2.internal' and this object" podUID="863033ed-576b-4a44-bf3f-cb0e62d27843" pod="opendatahub/test-curl-7900-140265321636896" Jul 15 23:00:23.371630 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:23.371596 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="863033ed-576b-4a44-bf3f-cb0e62d27843" path="/var/lib/kubelet/pods/863033ed-576b-4a44-bf3f-cb0e62d27843/volumes" Jul 15 23:00:35.825376 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:35.825344 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8"] Jul 15 23:00:35.829612 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:35.829587 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d5b2a8-29735940-bght8"] Jul 15 23:00:37.371030 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:00:37.370993 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee933881-9cb5-4b3d-acdb-dd1c111dfea7" path="/var/lib/kubelet/pods/ee933881-9cb5-4b3d-acdb-dd1c111dfea7/volumes" Jul 15 23:01:01.786986 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:01.786953 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp"] Jul 15 23:01:01.790209 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:01.790186 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-1e65bd-29735940-6zvsp"] Jul 15 23:01:03.372062 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:03.372027 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06aeb106-cf0f-42c4-b91a-900629d6eb84" path="/var/lib/kubelet/pods/06aeb106-cf0f-42c4-b91a-900629d6eb84/volumes" Jul 15 23:01:23.353022 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:23.352949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j6rxq_a6e7ca22-a5e1-4034-8d26-9a7aeefce81d/manager/0.log" Jul 15 23:01:23.489383 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:23.489357 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wnwcz_286c5119-8502-49e1-8de4-f0a8005c8d4b/manager/0.log" Jul 15 23:01:23.770695 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:23.770668 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vzj8p_7de6d254-3f6a-41bd-9295-b8103d6da978/server/0.log" Jul 15 23:01:24.049281 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:24.049209 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-fqh68_cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5/copy-manifests/0.log" Jul 15 23:01:24.060509 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:24.060485 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-fqh68_cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5/manager/0.log" Jul 15 23:01:25.081940 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:25.081910 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735940-5bq7d_5088f046-4413-46a4-a5f6-a0d531177de2/cleanup/0.log" Jul 15 23:01:25.308725 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:25.308699 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-a0965552-zzgb9_ea936818-0e6f-4b41-b949-d85ff0201828/revoke-keys/1.log" Jul 15 23:01:25.772849 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:25.772825 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-30c9f8-8qq4c_e80c61a8-9d6b-4140-ae34-e92420d168c9/revoke-keys/0.log" Jul 15 23:01:27.376254 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.376219 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht_b49d5582-524e-49af-bbd0-64c5dc0a8904/util/0.log" Jul 15 23:01:27.382584 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.382565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht_b49d5582-524e-49af-bbd0-64c5dc0a8904/pull/0.log" Jul 15 23:01:27.388758 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.388741 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht_b49d5582-524e-49af-bbd0-64c5dc0a8904/extract/0.log" Jul 15 23:01:27.499039 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.499017 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6_80dab9d1-2dc7-4347-b8fc-8b30327d7631/util/0.log" Jul 15 23:01:27.505171 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.505148 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6_80dab9d1-2dc7-4347-b8fc-8b30327d7631/pull/0.log" Jul 15 23:01:27.511024 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.511004 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6_80dab9d1-2dc7-4347-b8fc-8b30327d7631/extract/0.log" Jul 15 23:01:27.621468 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.621451 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br_131009fc-f0f4-4738-86a2-1b94a8adc343/extract/0.log" Jul 15 23:01:27.627794 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.627744 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br_131009fc-f0f4-4738-86a2-1b94a8adc343/util/0.log" Jul 15 23:01:27.633693 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.633674 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br_131009fc-f0f4-4738-86a2-1b94a8adc343/pull/0.log" Jul 15 23:01:27.750619 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.750599 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6_6fbaaa2d-c919-4632-8d5c-c1f275fec69e/util/0.log" Jul 15 23:01:27.757382 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.757362 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6_6fbaaa2d-c919-4632-8d5c-c1f275fec69e/pull/0.log" Jul 15 23:01:27.763455 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:27.763439 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6_6fbaaa2d-c919-4632-8d5c-c1f275fec69e/extract/0.log" Jul 15 23:01:28.009519 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:28.009442 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-sfvkc_0dc26d5e-d2cc-4f98-b68a-4d4b50620014/manager/0.log" Jul 15 23:01:28.358065 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:28.357989 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vddjt_2109285c-833c-4790-a242-ad32c551c9bf/registry-server/0.log" Jul 15 23:01:28.481591 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:28.481565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8xtml_a3ed90e6-790f-46ba-86fc-42b05b58649d/manager/0.log" Jul 15 23:01:28.724015 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:28.723988 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jpcsx_2efde057-50a4-43dc-8ba5-541c7bfc9464/manager/0.log" Jul 15 23:01:29.213303 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:29.213261 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xcgt4_ad13bdb4-ba0c-451e-8092-8145f173eb3a/discovery/0.log" Jul 15 23:01:29.325258 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:29.325228 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8547df878-4zbp2_3ddde4ae-5960-4368-b564-b660e92ff79e/kube-auth-proxy/0.log" Jul 15 23:01:30.620549 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:30.620512 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbq64nd_d947a12b-791c-4f13-a81a-c2d6c8bd99e0/main/0.log" Jul 15 23:01:30.731943 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:30.731918 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-vwpsr_188deca8-472d-42c5-b7d2-a8cb6aeca986/main/0.log" Jul 15 23:01:39.300158 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:39.300099 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hp4bm_62f11e48-e712-4fdc-89ab-22758881823d/global-pull-secret-syncer/0.log" Jul 15 23:01:39.447251 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:39.447219 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9t8qj_225cb751-612d-4b5f-b46c-18468dd0b23c/konnectivity-agent/0.log" Jul 15 23:01:39.526718 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:39.526692 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-87.ec2.internal_975caee66701c49e86b719a0cf012f15/haproxy/0.log" Jul 15 23:01:44.085012 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.084981 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht_b49d5582-524e-49af-bbd0-64c5dc0a8904/extract/0.log" Jul 15 23:01:44.114916 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.114892 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht_b49d5582-524e-49af-bbd0-64c5dc0a8904/util/0.log" Jul 15 23:01:44.140351 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.140329 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759tctht_b49d5582-524e-49af-bbd0-64c5dc0a8904/pull/0.log" Jul 15 23:01:44.184497 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.184477 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6_80dab9d1-2dc7-4347-b8fc-8b30327d7631/extract/0.log" Jul 15 23:01:44.206670 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.206650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6_80dab9d1-2dc7-4347-b8fc-8b30327d7631/util/0.log" Jul 15 23:01:44.234089 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.234070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gp9g6_80dab9d1-2dc7-4347-b8fc-8b30327d7631/pull/0.log" Jul 15 23:01:44.271396 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.271379 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br_131009fc-f0f4-4738-86a2-1b94a8adc343/extract/0.log" Jul 15 23:01:44.298231 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.298214 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br_131009fc-f0f4-4738-86a2-1b94a8adc343/util/0.log" Jul 15 23:01:44.321229 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.321212 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hm5br_131009fc-f0f4-4738-86a2-1b94a8adc343/pull/0.log" Jul 15 23:01:44.355331 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.355265 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6_6fbaaa2d-c919-4632-8d5c-c1f275fec69e/extract/0.log" Jul 15 23:01:44.376946 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.376928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6_6fbaaa2d-c919-4632-8d5c-c1f275fec69e/util/0.log" Jul 15 23:01:44.403819 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.403800 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18zqr6_6fbaaa2d-c919-4632-8d5c-c1f275fec69e/pull/0.log" Jul 15 23:01:44.931077 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:44.931050 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-sfvkc_0dc26d5e-d2cc-4f98-b68a-4d4b50620014/manager/0.log" Jul 15 23:01:45.046451 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:45.046423 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vddjt_2109285c-833c-4790-a242-ad32c551c9bf/registry-server/0.log" Jul 15 23:01:45.166116 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:45.166089 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8xtml_a3ed90e6-790f-46ba-86fc-42b05b58649d/manager/0.log" Jul 15 23:01:45.276771 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:45.276705 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jpcsx_2efde057-50a4-43dc-8ba5-541c7bfc9464/manager/0.log" Jul 15 23:01:46.970622 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:46.970594 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e719288d-75d9-463d-9f54-e9e4d60d9100/alertmanager/0.log" Jul 15 23:01:46.995643 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:46.995615 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e719288d-75d9-463d-9f54-e9e4d60d9100/config-reloader/0.log" Jul 15 23:01:47.017404 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.017386 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e719288d-75d9-463d-9f54-e9e4d60d9100/kube-rbac-proxy-web/0.log" Jul 15 23:01:47.048875 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.048850 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e719288d-75d9-463d-9f54-e9e4d60d9100/kube-rbac-proxy/0.log" Jul 15 23:01:47.077195 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.077180 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e719288d-75d9-463d-9f54-e9e4d60d9100/kube-rbac-proxy-metric/0.log" Jul 15 23:01:47.101869 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.101851 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e719288d-75d9-463d-9f54-e9e4d60d9100/prom-label-proxy/0.log" Jul 15 23:01:47.126614 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.126596 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e719288d-75d9-463d-9f54-e9e4d60d9100/init-config-reloader/0.log" Jul 15 23:01:47.640807 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.640780 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gjf2w_cdcbcda4-adab-4393-81e6-e099ecea7587/node-exporter/0.log" Jul 15 23:01:47.671399 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.671376 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gjf2w_cdcbcda4-adab-4393-81e6-e099ecea7587/kube-rbac-proxy/0.log" Jul 15 23:01:47.705996 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.705977 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gjf2w_cdcbcda4-adab-4393-81e6-e099ecea7587/init-textfile/0.log" Jul 15 23:01:47.817577 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.817554 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qhfm5_45a17e1c-4406-4803-9e5f-11f13e67824c/kube-rbac-proxy-main/0.log" Jul 15 23:01:47.840383 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.840350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qhfm5_45a17e1c-4406-4803-9e5f-11f13e67824c/kube-rbac-proxy-self/0.log" Jul 15 23:01:47.867553 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:47.867508 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qhfm5_45a17e1c-4406-4803-9e5f-11f13e67824c/openshift-state-metrics/0.log" Jul 15 23:01:48.077513 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.077488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xtthp_65255593-7351-44fd-891f-91ca39f2a91f/prometheus-operator/0.log" Jul 15 23:01:48.096523 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.096504 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xtthp_65255593-7351-44fd-891f-91ca39f2a91f/kube-rbac-proxy/0.log" Jul 15 23:01:48.123929 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.123908 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-kwqdc_38da7c18-489d-49ff-8f9d-29a833cc40c8/prometheus-operator-admission-webhook/0.log" Jul 15 23:01:48.154259 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.154239 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-966d99596-2wxwl_ed289551-2cc6-4a9a-836e-132441e0825d/telemeter-client/0.log" Jul 15 23:01:48.177776 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.177761 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-966d99596-2wxwl_ed289551-2cc6-4a9a-836e-132441e0825d/reload/0.log" Jul 15 23:01:48.201625 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.201574 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-966d99596-2wxwl_ed289551-2cc6-4a9a-836e-132441e0825d/kube-rbac-proxy/0.log" Jul 15 23:01:48.239467 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.239449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f65bc8fc9-n8gk4_b257f16d-31da-424a-a8f2-3d864023c88e/thanos-query/0.log" Jul 15 23:01:48.261928 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.261907 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f65bc8fc9-n8gk4_b257f16d-31da-424a-a8f2-3d864023c88e/kube-rbac-proxy-web/0.log" Jul 15 23:01:48.284874 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.284858 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f65bc8fc9-n8gk4_b257f16d-31da-424a-a8f2-3d864023c88e/kube-rbac-proxy/0.log" Jul 15 23:01:48.306767 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.306749 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f65bc8fc9-n8gk4_b257f16d-31da-424a-a8f2-3d864023c88e/prom-label-proxy/0.log" Jul 15 23:01:48.329231 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.329212 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f65bc8fc9-n8gk4_b257f16d-31da-424a-a8f2-3d864023c88e/kube-rbac-proxy-rules/0.log" Jul 15 23:01:48.351880 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:48.351862 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f65bc8fc9-n8gk4_b257f16d-31da-424a-a8f2-3d864023c88e/kube-rbac-proxy-metrics/0.log" Jul 15 23:01:49.494860 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.494824 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t"] Jul 15 23:01:49.495424 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.495405 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="863033ed-576b-4a44-bf3f-cb0e62d27843" containerName="test-curl-7900-140265321636896" Jul 15 23:01:49.495523 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.495426 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="863033ed-576b-4a44-bf3f-cb0e62d27843" containerName="test-curl-7900-140265321636896" Jul 15 23:01:49.495523 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.495514 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="863033ed-576b-4a44-bf3f-cb0e62d27843" containerName="test-curl-7900-140265321636896" Jul 15 23:01:49.498448 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.498427 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.500986 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.500970 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxsw4\"/\"kube-root-ca.crt\"" Jul 15 23:01:49.501077 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.501002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rxsw4\"/\"default-dockercfg-7dk94\"" Jul 15 23:01:49.502010 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.501995 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxsw4\"/\"openshift-service-ca.crt\"" Jul 15 23:01:49.507670 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.507651 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t"] Jul 15 23:01:49.609338 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.609317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-proc\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.609443 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.609343 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-sys\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.609443 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.609367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-podres\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.609539 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.609460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-lib-modules\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.609539 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.609486 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rfsj\" (UniqueName: \"kubernetes.io/projected/537794dd-290a-4467-9068-ed324351b65d-kube-api-access-8rfsj\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710132 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-podres\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710247 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710154 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-lib-modules\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710247 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710170 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rfsj\" (UniqueName: \"kubernetes.io/projected/537794dd-290a-4467-9068-ed324351b65d-kube-api-access-8rfsj\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710247 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-proc\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710247 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-sys\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710465 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710306 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-sys\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710465 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710310 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-lib-modules\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710465 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710306 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-podres\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.710465 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.710341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/537794dd-290a-4467-9068-ed324351b65d-proc\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.717836 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.717803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rfsj\" (UniqueName: \"kubernetes.io/projected/537794dd-290a-4467-9068-ed324351b65d-kube-api-access-8rfsj\") pod \"perf-node-gather-daemonset-l7v6t\" (UID: \"537794dd-290a-4467-9068-ed324351b65d\") " pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.808569 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.808492 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:49.937611 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:49.937583 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t"] Jul 15 23:01:49.939187 ip-10-0-136-87 kubenswrapper[2564]: W0715 23:01:49.939157 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod537794dd_290a_4467_9068_ed324351b65d.slice/crio-3beaceff1d3c04e9ea06fc562ee943794b5bfc943f346dd3106e5a870291ceee WatchSource:0}: Error finding container 3beaceff1d3c04e9ea06fc562ee943794b5bfc943f346dd3106e5a870291ceee: Status 404 returned error can't find the container with id 3beaceff1d3c04e9ea06fc562ee943794b5bfc943f346dd3106e5a870291ceee Jul 15 23:01:50.779203 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:50.779167 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" event={"ID":"537794dd-290a-4467-9068-ed324351b65d","Type":"ContainerStarted","Data":"9f274d40e3567d105bb922a6465bb1546c7cb5f3f046c9693be82835a9a942b7"} Jul 15 23:01:50.779637 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:50.779217 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" event={"ID":"537794dd-290a-4467-9068-ed324351b65d","Type":"ContainerStarted","Data":"3beaceff1d3c04e9ea06fc562ee943794b5bfc943f346dd3106e5a870291ceee"} Jul 15 23:01:50.779637 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:50.779313 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:50.797555 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:50.797512 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" podStartSLOduration=1.7974993929999998 podStartE2EDuration="1.797499393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 23:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 23:01:50.796206304 +0000 UTC m=+2725.966863742" watchObservedRunningTime="2026-07-15 23:01:50.797499393 +0000 UTC m=+2725.968156830" Jul 15 23:01:52.222770 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:52.222747 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d5j7w_34471794-0361-45e0-b1b2-429d0833d689/dns/0.log" Jul 15 23:01:52.246858 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:52.246838 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d5j7w_34471794-0361-45e0-b1b2-429d0833d689/kube-rbac-proxy/0.log" Jul 15 23:01:52.366924 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:52.366907 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4tf58_91881515-819d-4d72-af89-5a346c2df818/dns-node-resolver/0.log" Jul 15 23:01:52.948313 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:52.948269 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m2mrj_a7cdc335-ff35-425f-8920-3653c3148dd0/node-ca/0.log" Jul 15 23:01:54.011041 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:54.011012 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xcgt4_ad13bdb4-ba0c-451e-8092-8145f173eb3a/discovery/0.log" Jul 15 23:01:54.033198 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:54.033161 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8547df878-4zbp2_3ddde4ae-5960-4368-b564-b660e92ff79e/kube-auth-proxy/0.log" Jul 15 23:01:54.847911 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:54.847887 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9shlm_64057592-8295-4199-a7ab-f61b91b3121e/serve-healthcheck-canary/0.log" Jul 15 23:01:55.546245 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:55.546214 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnbgx_52da1a4a-39ed-4b69-b42d-5dbd03e64e07/kube-rbac-proxy/0.log" Jul 15 23:01:55.566000 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:55.565975 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnbgx_52da1a4a-39ed-4b69-b42d-5dbd03e64e07/exporter/0.log" Jul 15 23:01:55.586224 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:55.586204 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jnbgx_52da1a4a-39ed-4b69-b42d-5dbd03e64e07/extractor/0.log" Jul 15 23:01:56.793961 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:56.793938 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rxsw4/perf-node-gather-daemonset-l7v6t" Jul 15 23:01:57.670500 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:57.670476 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-j6rxq_a6e7ca22-a5e1-4034-8d26-9a7aeefce81d/manager/0.log" Jul 15 23:01:57.798177 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:57.798151 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wnwcz_286c5119-8502-49e1-8de4-f0a8005c8d4b/manager/0.log" Jul 15 23:01:57.914107 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:57.914082 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vzj8p_7de6d254-3f6a-41bd-9295-b8103d6da978/server/0.log" Jul 15 23:01:58.057617 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:58.057547 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-fqh68_cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5/manager/0.log" Jul 15 23:01:58.081968 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:58.081942 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dbfb5d546-fqh68_cb2bc9e1-b1be-44e2-96f0-48d82fa2e9c5/copy-manifests/0.log" Jul 15 23:01:59.835624 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:01:59.835591 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q8kb2_2595505e-0f98-4b38-9c75-c9f7b60c5df7/openshift-lws-operator/0.log" Jul 15 23:02:00.294502 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:00.294464 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xcgt4_ad13bdb4-ba0c-451e-8092-8145f173eb3a/discovery/0.log" Jul 15 23:02:00.305725 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:00.305704 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8547df878-4zbp2_3ddde4ae-5960-4368-b564-b660e92ff79e/kube-auth-proxy/0.log" Jul 15 23:02:01.752856 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:01.752826 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xcgt4_ad13bdb4-ba0c-451e-8092-8145f173eb3a/discovery/0.log" Jul 15 23:02:01.764251 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:01.764227 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8547df878-4zbp2_3ddde4ae-5960-4368-b564-b660e92ff79e/kube-auth-proxy/0.log" Jul 15 23:02:06.100713 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.100639 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvdhq_c780bef1-c7eb-422f-a162-bd84f5ef20ca/kube-multus-additional-cni-plugins/0.log" Jul 15 23:02:06.123203 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.123182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvdhq_c780bef1-c7eb-422f-a162-bd84f5ef20ca/egress-router-binary-copy/0.log" Jul 15 23:02:06.144053 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.144034 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvdhq_c780bef1-c7eb-422f-a162-bd84f5ef20ca/cni-plugins/0.log" Jul 15 23:02:06.164890 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.164869 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvdhq_c780bef1-c7eb-422f-a162-bd84f5ef20ca/bond-cni-plugin/0.log" Jul 15 23:02:06.186146 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.186129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvdhq_c780bef1-c7eb-422f-a162-bd84f5ef20ca/routeoverride-cni/0.log" Jul 15 23:02:06.206731 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.206712 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvdhq_c780bef1-c7eb-422f-a162-bd84f5ef20ca/whereabouts-cni-bincopy/0.log" Jul 15 23:02:06.226658 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.226641 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvdhq_c780bef1-c7eb-422f-a162-bd84f5ef20ca/whereabouts-cni/0.log" Jul 15 23:02:06.578392 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.578366 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gz5dt_087a2888-741d-49e1-88e2-2ad9b12e3a02/kube-multus/0.log" Jul 15 23:02:06.713297 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.713254 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7rh6n_4469b73c-e23d-408d-be6b-656c08681932/network-metrics-daemon/0.log" Jul 15 23:02:06.733270 ip-10-0-136-87 kubenswrapper[2564]: I0715 23:02:06.733244 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7rh6n_4469b73c-e23d-408d-be6b-656c08681932/kube-rbac-proxy/0.log"