Jul 14 18:52:10.352789 ip-10-0-131-27 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 14 18:52:10.352802 ip-10-0-131-27 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 14 18:52:10.352812 ip-10-0-131-27 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 14 18:52:10.353168 ip-10-0-131-27 systemd[1]: Failed to start Kubernetes Kubelet. Jul 14 18:52:20.559024 ip-10-0-131-27 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 14 18:52:20.559043 ip-10-0-131-27 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0376361d01fd4f5dbd832be98ea2b36c -- Jul 14 18:53:56.524511 ip-10-0-131-27 systemd[1]: Starting Kubernetes Kubelet... Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.954822 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958892 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958903 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958907 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958911 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958914 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958917 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958920 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:53:56.961322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958924 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958927 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958930 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958933 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958935 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958938 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958941 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958944 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958947 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958950 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958952 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958955 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958957 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958960 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958963 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958965 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958968 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958971 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958977 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:53:56.975512 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958980 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958982 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958985 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958987 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958990 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958993 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958995 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.958997 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959000 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959002 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959007 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959011 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959015 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959018 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959020 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959030 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959034 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959037 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959040 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:53:56.979945 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959043 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959046 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959048 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959051 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959055 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959060 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959064 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959067 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959070 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959073 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959075 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959078 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959080 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959083 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959087 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959090 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959092 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959095 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959098 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:53:56.999033 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959100 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959103 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959105 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959108 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959110 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959113 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959116 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959119 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959122 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959124 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959127 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959130 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959133 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959136 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959139 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959141 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959144 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959146 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959149 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959151 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:53:57.001048 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959154 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959156 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959159 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959162 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959165 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959167 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959170 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959172 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959175 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959178 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959180 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959183 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959185 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959188 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959190 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959893 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959900 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959904 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959907 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:53:57.024055 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959910 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959914 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959919 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959922 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959926 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959929 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959931 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959935 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959938 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959940 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959943 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959946 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959949 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959951 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959954 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959956 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959959 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959963 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959966 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:53:57.028092 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959969 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959972 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959975 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959978 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959981 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959983 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959986 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959988 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959991 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959993 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959996 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.959998 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960001 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960006 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960009 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960012 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960015 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960021 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960024 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960027 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:53:57.043825 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960030 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:53:57.041368 ip-10-0-131-27 systemd[1]: Started Kubernetes Kubelet. Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960033 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960036 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960039 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960041 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960044 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960046 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960048 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960051 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960054 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960056 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960059 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960061 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960064 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960066 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960069 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960072 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960074 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960077 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960080 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:53:57.049991 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960082 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960085 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960088 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960090 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960093 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960097 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960099 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960102 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960104 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960107 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960109 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960111 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960115 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960117 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960121 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960123 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960126 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960128 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960131 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960133 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:53:57.064912 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960136 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960138 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960141 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960143 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960146 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960148 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960151 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960155 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960158 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960160 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960163 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960165 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960168 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960170 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960173 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960175 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960630 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960639 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960643 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:53:57.073077 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960646 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960649 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960653 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960656 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960659 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960662 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960665 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960675 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960677 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960680 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960683 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960685 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960688 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960691 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960693 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960696 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960698 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960701 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960703 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960706 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:53:57.238730 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960710 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960712 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960715 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960718 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960721 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960724 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960726 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960729 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960732 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960734 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960739 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960741 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960744 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960746 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960749 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960752 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960754 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960757 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960759 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:53:57.253010 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960762 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960765 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960767 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960770 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960772 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960775 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960777 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960780 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960782 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960785 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960787 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960792 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960795 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960800 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960802 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960806 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960810 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960815 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960819 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:53:57.258220 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960824 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960827 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960830 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960833 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960837 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960839 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960843 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960845 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960848 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960851 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960854 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960857 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960859 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960862 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960865 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960868 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960870 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960873 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960875 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960878 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:53:57.259039 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960880 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960882 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960885 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960887 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960890 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960892 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960896 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960899 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960902 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960904 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960907 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960909 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960912 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960914 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960917 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960919 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960923 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.960926 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.960994 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961000 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 18:53:57.259838 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961010 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961014 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961019 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961022 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961026 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961030 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961033 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961036 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961046 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961049 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961052 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961055 2573 flags.go:64] FLAG: --cgroup-root="" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961058 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961061 2573 flags.go:64] FLAG: --client-ca-file="" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961063 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961066 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961073 2573 flags.go:64] FLAG: --cluster-domain="" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961075 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961080 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961083 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961086 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961098 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961101 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 18:53:57.265108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961105 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961108 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961111 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961114 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961117 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961121 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961124 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961128 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961131 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961134 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961137 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961140 2573 flags.go:64] FLAG: --enable-server="true" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961143 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961150 2573 flags.go:64] FLAG: --event-burst="100" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961153 2573 flags.go:64] FLAG: --event-qps="50" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961156 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961159 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961162 2573 flags.go:64] FLAG: --eviction-hard="" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961171 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961175 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961177 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961181 2573 flags.go:64] FLAG: --eviction-soft="" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961184 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961188 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961192 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 18:53:57.265897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961195 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961198 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961203 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961207 2573 flags.go:64] FLAG: --feature-gates="" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961212 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961216 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961221 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961225 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961245 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961250 2573 flags.go:64] FLAG: --help="false" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961254 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961258 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961265 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961269 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961274 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961279 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961283 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961288 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961293 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961297 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961302 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961306 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961311 2573 flags.go:64] FLAG: --kube-reserved="" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961316 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 18:53:57.267118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961320 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961324 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961329 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961334 2573 flags.go:64] FLAG: --lock-file="" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961338 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961343 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961347 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961355 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961359 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961363 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961369 2573 flags.go:64] FLAG: --logging-format="text" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961373 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961377 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961381 2573 flags.go:64] FLAG: --manifest-url="" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961385 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961390 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961394 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961400 2573 flags.go:64] FLAG: --max-pods="110" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961404 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961408 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961413 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961417 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961421 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961425 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961429 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 18:53:57.269555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961439 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961443 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961447 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961451 2573 flags.go:64] FLAG: --pod-cidr="" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961454 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961462 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961465 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961470 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961474 2573 flags.go:64] FLAG: --port="10250" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961478 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961482 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cfd2c70db0bcf657" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961487 2573 flags.go:64] FLAG: --qos-reserved="" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961490 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961494 2573 flags.go:64] FLAG: --register-node="true" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961498 2573 flags.go:64] FLAG: --register-with-taints="" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961503 2573 flags.go:64] FLAG: --registry-burst="10" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961507 2573 flags.go:64] FLAG: --registry-qps="5" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961512 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961516 2573 flags.go:64] FLAG: --reserved-memory="" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961528 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961533 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961537 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961541 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961545 2573 flags.go:64] FLAG: --runonce="false" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961549 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 18:53:57.270425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961553 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961557 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961561 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961567 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961570 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961575 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961579 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961583 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961588 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961592 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961596 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961601 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961605 2573 flags.go:64] FLAG: --system-cgroups="" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961608 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961616 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961620 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961624 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961636 2573 flags.go:64] FLAG: --tls-min-version="" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961640 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961644 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961648 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961652 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961656 2573 flags.go:64] FLAG: --v="2" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961661 2573 flags.go:64] FLAG: --version="false" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961670 2573 flags.go:64] FLAG: --vmodule="" Jul 14 18:53:57.273351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961674 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.961679 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961875 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961883 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961888 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961892 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961896 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961901 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961905 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961912 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961920 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961925 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961930 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961934 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961939 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961943 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961947 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961951 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961955 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961960 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:53:57.274211 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961964 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961968 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961973 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961977 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961981 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961987 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961994 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.961999 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962003 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962007 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962012 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962018 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962023 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962027 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962031 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962035 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962040 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962044 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962048 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:53:57.380888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962052 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962057 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962061 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962068 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962072 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962076 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962080 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962084 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962089 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962093 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962097 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962102 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962106 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962110 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962115 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962119 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962123 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962127 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962131 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962135 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:53:57.381707 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962140 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962145 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962149 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962153 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962159 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962163 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962167 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962172 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962176 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962180 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962185 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962189 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962193 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962197 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962201 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962207 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962212 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962217 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962221 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962225 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:53:57.390213 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962229 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962259 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962263 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962267 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962271 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962275 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962279 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962286 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962291 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962296 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962300 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962305 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962309 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962314 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962319 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962323 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962329 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962334 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962338 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962343 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:53:57.391433 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962348 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.962352 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.963772 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.970922 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.970936 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.971934 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.971942 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.971998 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972004 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972008 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972012 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972016 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972019 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972022 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:53:57.392252 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972025 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972028 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972032 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972035 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972037 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972040 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972043 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972046 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972049 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972051 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972054 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972057 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972060 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972062 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972065 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972067 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972070 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972073 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972075 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:53:57.489623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972078 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972081 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972084 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972090 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972093 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972096 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972098 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972101 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972103 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972106 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972108 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972111 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972113 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972116 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972118 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972121 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972123 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972125 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972128 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972130 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:53:57.490409 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972133 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972136 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972138 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972141 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972143 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972146 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972149 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972151 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972154 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972157 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972159 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972162 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972165 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972168 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972171 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972174 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972177 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972179 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972182 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972184 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972187 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:53:57.491599 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972189 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972192 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972194 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972197 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972200 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972202 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972205 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972207 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972209 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972212 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972214 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972217 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972221 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972224 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972226 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972229 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972246 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972251 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972254 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:53:57.492413 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972256 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972259 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972261 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972264 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972267 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972271 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972273 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972276 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972278 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972282 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972284 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972287 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972290 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.972295 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972403 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 18:53:57.493616 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972408 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972411 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972414 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972417 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972420 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972423 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972427 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972430 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972433 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972436 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972440 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972443 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972446 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972449 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972451 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972454 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972457 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972459 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972462 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 18:53:57.495217 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972464 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972467 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972469 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972472 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972477 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972479 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972482 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972484 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972488 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972491 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972493 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972496 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972498 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972501 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972504 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972507 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972509 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972512 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972514 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 18:53:57.495738 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972517 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972519 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972522 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972524 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972528 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972531 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972533 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972536 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972539 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972541 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972544 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972546 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972549 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972551 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972553 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972556 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972559 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972563 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972565 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972568 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 18:53:57.496202 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972570 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972573 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972576 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972579 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972582 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972584 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972588 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972591 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972594 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972597 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972599 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972602 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972604 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972607 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972610 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972613 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972616 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972619 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972622 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 18:53:57.496725 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972624 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972626 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972629 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972631 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972634 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972636 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972639 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972641 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972643 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972646 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972650 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972652 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972655 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972657 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972660 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972662 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972665 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972668 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972671 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972673 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 18:53:57.497178 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:56.972675 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.972680 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.972772 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.977869 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.979627 2573 server.go:1019] "Starting client certificate rotation" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.980090 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.980134 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.984103 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:56.989551 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.002630 2573 log.go:25] "Validated CRI v1 runtime API" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.007701 2573 log.go:25] "Validated CRI v1 image API" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.008413 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 18:53:57.497663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.012046 2573 fs.go:135] Filesystem UUIDs: map[677d791c-f2b4-4336-980e-d5063f91242f:/dev/nvme0n1p3 6b6cdf67-8757-4d68-ac41-cc5ac474dc2b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 14 18:53:57.497963 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.012063 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 18:53:57.497998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.016500 2573 manager.go:216] Machine: {Timestamp:2026-07-14 18:53:57.016013596 +0000 UTC m=+0.368837107 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102127 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec223f512dce97d2b6d454aee0f03589 SystemUUID:ec223f51-2dce-97d2-b6d4-54aee0f03589 BootID:0376361d-01fd-4f5d-bd83-2be98ea2b36c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a1:aa:9f:1e:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a1:aa:9f:1e:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:04:56:b9:29:46 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 18:53:57.497998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.016585 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 18:53:57.497998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.016687 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 18:53:57.497998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.019861 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 18:53:57.497998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.019883 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 18:53:57.497998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.020696 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 18:53:57.497998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.020705 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 18:53:57.497998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.020713 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.020723 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.022703 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.023800 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026051 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026168 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026194 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026203 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026222 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026252 2573 kubelet.go:398] "Adding apiserver pod source" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026264 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026653 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.026671 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.032987 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.035607 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.035644 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.035896 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.035912 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.035921 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.035929 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.035940 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.035948 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.036491 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.036498 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.036508 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.036516 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.036528 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.036538 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.037408 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.037422 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.040399 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.040576 2573 server.go:1268] "Started kubelet" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.040659 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.040757 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.040814 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.041022 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.041051 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.041687 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 14 18:53:57.498255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.042123 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.048532 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-27.ec2.internal.18c23cc9277a3e6c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-27.ec2.internal,UID:ip-10-0-131-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-27.ec2.internal,},FirstTimestamp:2026-07-14 18:53:57.04055358 +0000 UTC m=+0.393377095,LastTimestamp:2026-07-14 18:53:57.04055358 +0000 UTC m=+0.393377095,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-27.ec2.internal,}" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.050817 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.051372 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.051484 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.052049 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.052065 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.052376 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.052428 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.052435 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.053139 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.053278 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.053292 2573 factory.go:55] Registering systemd factory Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.053302 2573 factory.go:223] Registration of the systemd container factory successfully Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.053536 2573 factory.go:153] Registering CRI-O factory Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.053551 2573 factory.go:223] Registration of the crio container factory successfully Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.053581 2573 factory.go:103] Registering Raw factory Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.053597 2573 manager.go:1196] Started watching for new ooms in manager Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.054113 2573 manager.go:349] Starting recovery of all containers Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.059809 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.060100 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.069145 2573 manager.go:354] Recovery completed Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.074492 2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.077388 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.079107 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.079135 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.079149 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.079639 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.079649 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.079664 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.079669 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.080269 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:53:57.499221 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.080295 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.080308 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.080862 2573 policy_none.go:49] "None policy: Start" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.080875 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.080886 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.081058 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-27.ec2.internal.18c23cc929c6bcb8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-27.ec2.internal,UID:ip-10-0-131-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-27.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-27.ec2.internal,},FirstTimestamp:2026-07-14 18:53:57.07912108 +0000 UTC m=+0.431944595,LastTimestamp:2026-07-14 18:53:57.07912108 +0000 UTC m=+0.431944595,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-27.ec2.internal,}" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.081815 2573 policy_none.go:47] "Start" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.089003 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rc494" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.090861 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-27.ec2.internal.18c23cc929c70e2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-27.ec2.internal,UID:ip-10-0-131-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-27.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-27.ec2.internal,},FirstTimestamp:2026-07-14 18:53:57.079141931 +0000 UTC m=+0.431965450,LastTimestamp:2026-07-14 18:53:57.079141931 +0000 UTC m=+0.431965450,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-27.ec2.internal,}" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.100927 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rc494" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.105625 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-27.ec2.internal.18c23cc929c73bed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-27.ec2.internal,UID:ip-10-0-131-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-27.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-27.ec2.internal,},FirstTimestamp:2026-07-14 18:53:57.079153645 +0000 UTC m=+0.431977157,LastTimestamp:2026-07-14 18:53:57.079153645 +0000 UTC m=+0.431977157,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-27.ec2.internal,}" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.109605 2573 manager.go:337] "Starting Device Plugin manager" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.109629 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.109637 2573 server.go:87] "Starting device plugin registration server" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.109821 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.109834 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.110000 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.110071 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.110079 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.110456 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 18:53:57.500070 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.110500 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.168045 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.169156 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.169188 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.169218 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.169281 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.171965 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.210793 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.211602 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.211626 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.211637 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.211657 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.222695 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.222715 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-27.ec2.internal\": node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.260440 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.269579 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"] Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.269623 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.270337 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.270355 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.270363 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.271522 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.271803 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.271822 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.272439 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.272457 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.272465 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.272642 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.272652 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.272660 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.273708 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.273730 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.274472 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.274488 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:53:57.500608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.274496 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:53:57.518065 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.518041 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.543151 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.543131 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.547474 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.547458 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.618742 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.618717 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.618812 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.618763 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4ea88a121a641dae990504772a5f753-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"b4ea88a121a641dae990504772a5f753\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.618812 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.618787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85f1899aaa44e5cf0afd9d7f08b383f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"85f1899aaa44e5cf0afd9d7f08b383f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.618812 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.618804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85f1899aaa44e5cf0afd9d7f08b383f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"85f1899aaa44e5cf0afd9d7f08b383f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.719012 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.718981 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.719088 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.719006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4ea88a121a641dae990504772a5f753-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"b4ea88a121a641dae990504772a5f753\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.719088 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.719047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85f1899aaa44e5cf0afd9d7f08b383f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"85f1899aaa44e5cf0afd9d7f08b383f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.719088 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.719066 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85f1899aaa44e5cf0afd9d7f08b383f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"85f1899aaa44e5cf0afd9d7f08b383f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.719170 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.719103 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85f1899aaa44e5cf0afd9d7f08b383f4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"85f1899aaa44e5cf0afd9d7f08b383f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.719170 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.719119 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4ea88a121a641dae990504772a5f753-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"b4ea88a121a641dae990504772a5f753\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.719170 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.719105 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/85f1899aaa44e5cf0afd9d7f08b383f4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"85f1899aaa44e5cf0afd9d7f08b383f4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.824242 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.824202 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.846013 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.845990 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.850041 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.850022 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:57.901326 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.901304 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:53:57.925581 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:57.925556 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:57.979544 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.979517 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 18:53:57.980067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.979632 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 18:53:57.980067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:57.979665 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 18:53:58.028547 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:58.028520 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:58.104517 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.104449 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 18:48:57 +0000 UTC" deadline="2028-04-07 20:48:19.99568401 +0000 UTC" Jul 14 18:53:58.104517 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.104489 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15193h54m21.891209332s" Jul 14 18:53:58.129483 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:58.129461 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:58.233403 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:58.233367 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:58.233507 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.233415 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 18:53:58.234843 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.234827 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jul 14 18:53:58.234904 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.234858 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 18:53:58.234904 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.234868 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jul 14 18:53:58.334308 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:58.334280 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jul 14 18:53:58.372311 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.372237 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:53:58.452581 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.452543 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jul 14 18:53:58.465267 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.465223 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 18:53:58.466259 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.466232 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jul 14 18:53:58.482772 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.482746 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 18:53:58.554283 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.554262 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:53:58.600322 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:58.600277 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ea88a121a641dae990504772a5f753.slice/crio-a08cbc9cf0342197e1e1da9e7498f2230de4a49fa0e19d066e5cfc03a2c3637c WatchSource:0}: Error finding container a08cbc9cf0342197e1e1da9e7498f2230de4a49fa0e19d066e5cfc03a2c3637c: Status 404 returned error can't find the container with id a08cbc9cf0342197e1e1da9e7498f2230de4a49fa0e19d066e5cfc03a2c3637c Jul 14 18:53:58.605537 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:58.605520 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 18:53:58.725726 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:58.725694 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f1899aaa44e5cf0afd9d7f08b383f4.slice/crio-81cfe952ce07c2bdd3b530a9bcf296e494c1a4f3aaacf49aa8f2a83581594b30 WatchSource:0}: Error finding container 81cfe952ce07c2bdd3b530a9bcf296e494c1a4f3aaacf49aa8f2a83581594b30: Status 404 returned error can't find the container with id 81cfe952ce07c2bdd3b530a9bcf296e494c1a4f3aaacf49aa8f2a83581594b30 Jul 14 18:53:59.029456 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.029368 2573 apiserver.go:52] "Watching apiserver" Jul 14 18:53:59.037749 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.037719 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 18:53:59.038776 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.038754 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-zg68b","openshift-network-operator/iptables-alerter-nvsrx","openshift-ovn-kubernetes/ovnkube-node-56nsw","kube-system/global-pull-secret-syncer-5nq78","kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv","openshift-cluster-node-tuning-operator/tuned-6bdjf","openshift-image-registry/node-ca-qtf7j","openshift-multus/multus-fcv5p","openshift-multus/network-metrics-daemon-29qh5","kube-system/konnectivity-agent-pglv2","openshift-dns/node-resolver-jbdkb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal","openshift-multus/multus-additional-cni-plugins-kgxnw"] Jul 14 18:53:59.040439 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.040423 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.041515 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.041470 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:53:59.042522 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.042508 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.043140 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.043119 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 18:53:59.043262 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.043124 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 18:53:59.043262 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.043190 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-56jqk\"" Jul 14 18:53:59.043262 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.043150 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 18:53:59.043641 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.043627 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 18:53:59.043784 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.043765 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.043863 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.043785 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kw9nc\"" Jul 14 18:53:59.043924 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.043863 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:53:59.043924 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.043898 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 18:53:59.044506 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.044488 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:53:59.044506 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.044509 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 18:53:59.045075 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.045057 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f6dwn\"" Jul 14 18:53:59.045168 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.045057 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.046712 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.046692 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:53:59.046786 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.046761 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:53:59.048152 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.048001 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 18:53:59.048152 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.048011 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 18:53:59.048152 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.048043 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 18:53:59.048152 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.048059 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.048544 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.048526 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 18:53:59.048620 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.048604 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-85wks\"" Jul 14 18:53:59.048675 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.048611 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 18:53:59.048793 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.048775 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 18:53:59.049418 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.049402 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.050457 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.050443 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 18:53:59.050648 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.050633 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vzj6n\"" Jul 14 18:53:59.050721 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.050704 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:53:59.050795 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.050775 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:53:59.050898 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.050877 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 18:53:59.051055 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.051038 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 18:53:59.051937 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.051920 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 18:53:59.052083 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.052069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.052267 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.052204 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 18:53:59.052367 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.052343 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 18:53:59.052427 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.052376 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 18:53:59.052542 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.052375 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r9kkj\"" Jul 14 18:53:59.052865 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.052849 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 18:53:59.053701 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.053670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.055915 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.055894 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:53:59.056172 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.056154 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rcmq4\"" Jul 14 18:53:59.057192 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.057059 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.057706 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.057683 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 18:53:59.058090 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.058068 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 18:53:59.058676 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.058655 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 18:53:59.058776 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.058729 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 18:53:59.059193 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.059177 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5dwqj\"" Jul 14 18:53:59.059553 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.059532 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 18:53:59.060099 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.060082 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bfcdn\"" Jul 14 18:53:59.060214 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.060188 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 18:53:59.074350 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.074331 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 18:53:59.093735 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.093719 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-t5k64" Jul 14 18:53:59.104451 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.104436 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-t5k64" Jul 14 18:53:59.152394 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-ovn\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.152505 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152400 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-modprobe-d\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.152505 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-lib-modules\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.152505 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-systemd-units\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.152505 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-etc-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.152696 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152510 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.152696 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152549 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-var-lib-kubelet\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.152696 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152581 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.152696 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:53:59.152696 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-os-release\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.152904 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152794 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4349e5a9-6016-4e67-85a5-7612f569236f-host-slash\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.152904 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152823 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-device-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.152904 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152853 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9v4t\" (UniqueName: \"kubernetes.io/projected/cc2c7107-449c-492a-859d-0c0533f0f5b4-kube-api-access-m9v4t\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.152904 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysconfig\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.152904 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-systemd\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.153107 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86658984-066d-4bd3-b244-f8164a16148d-ovn-node-metrics-cert\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.153107 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-cni-bin\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153107 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152946 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-kubernetes\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.153107 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.152960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-dbus\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.153107 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153066 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-kubelet\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.153107 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-node-log\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.153341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153126 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-k8s-cni-cncf-io\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-cni-multus\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153208 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 18:53:59.153341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153273 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-hostroot\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153292 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2grk\" (UniqueName: \"kubernetes.io/projected/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-kube-api-access-q2grk\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.153341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-log-socket\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.153341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-cni-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153342 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153372 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-system-cni-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153396 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghxzb\" (UniqueName: \"kubernetes.io/projected/3f06de43-8eb1-4dc4-93cd-81347784e533-kube-api-access-ghxzb\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b83fd31e-62ad-48d1-ba43-164ba56d677a-konnectivity-ca\") pod \"konnectivity-agent-pglv2\" (UID: \"b83fd31e-62ad-48d1-ba43-164ba56d677a\") " pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysctl-d\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-slash\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-socket-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153502 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-socket-dir-parent\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-conf-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghdm7\" (UniqueName: \"kubernetes.io/projected/4349e5a9-6016-4e67-85a5-7612f569236f-kube-api-access-ghdm7\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-var-lib-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153565 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh2gg\" (UniqueName: \"kubernetes.io/projected/9bca997e-1a43-4091-bf90-ca6b62edbaf9-kube-api-access-mh2gg\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.153608 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153597 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b83fd31e-62ad-48d1-ba43-164ba56d677a-agent-certs\") pod \"konnectivity-agent-pglv2\" (UID: \"b83fd31e-62ad-48d1-ba43-164ba56d677a\") " pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153625 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-ovnkube-script-lib\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153649 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-cnibin\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153665 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-sys\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153701 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-kubelet-config\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153718 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-run-ovn-kubernetes\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-cni-netd\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-env-overrides\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153769 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cj9k\" (UniqueName: \"kubernetes.io/projected/fe5424b3-5c95-41a1-a9f0-ec481c863c63-kube-api-access-9cj9k\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bca997e-1a43-4091-bf90-ca6b62edbaf9-cni-binary-copy\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153802 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f96s7\" (UniqueName: \"kubernetes.io/projected/86658984-066d-4bd3-b244-f8164a16148d-kube-api-access-f96s7\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-sys-fs\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe5424b3-5c95-41a1-a9f0-ec481c863c63-host\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.154091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysctl-conf\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153925 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-run\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153942 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-run-netns\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-cni-bin\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.153975 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-tmp\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-ovnkube-config\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-multus-certs\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154065 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-etc-kubernetes\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154081 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-tmp-dir\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-systemd\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe5424b3-5c95-41a1-a9f0-ec481c863c63-serviceca\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4349e5a9-6016-4e67-85a5-7612f569236f-iptables-alerter-script\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.154723 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-hosts-file\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.155272 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l4q7\" (UniqueName: \"kubernetes.io/projected/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-kube-api-access-7l4q7\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.155272 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-host\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.155272 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-tuned\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.155272 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-registration-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.155272 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-netns\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.155272 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154441 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-kubelet\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.155272 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.154486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-daemon-config\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.175783 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.175747 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"85f1899aaa44e5cf0afd9d7f08b383f4","Type":"ContainerStarted","Data":"81cfe952ce07c2bdd3b530a9bcf296e494c1a4f3aaacf49aa8f2a83581594b30"} Jul 14 18:53:59.176771 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.176751 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" event={"ID":"b4ea88a121a641dae990504772a5f753","Type":"ContainerStarted","Data":"a08cbc9cf0342197e1e1da9e7498f2230de4a49fa0e19d066e5cfc03a2c3637c"} Jul 14 18:53:59.255469 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255443 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-run-ovn-kubernetes\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.255568 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255468 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-cni-netd\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.255568 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255494 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-env-overrides\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.255568 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cj9k\" (UniqueName: \"kubernetes.io/projected/fe5424b3-5c95-41a1-a9f0-ec481c863c63-kube-api-access-9cj9k\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.255568 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255549 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bca997e-1a43-4091-bf90-ca6b62edbaf9-cni-binary-copy\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.255568 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255557 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-cni-netd\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.255762 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f96s7\" (UniqueName: \"kubernetes.io/projected/86658984-066d-4bd3-b244-f8164a16148d-kube-api-access-f96s7\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.255762 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255581 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-run-ovn-kubernetes\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.255762 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.255762 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-sys-fs\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.256012 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.255989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe5424b3-5c95-41a1-a9f0-ec481c863c63-host\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.256103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256021 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-sys-fs\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.256103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256044 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysctl-conf\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.256267 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256232 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysctl-conf\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.256351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256318 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe5424b3-5c95-41a1-a9f0-ec481c863c63-host\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.256429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-run\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.256509 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-run-netns\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.256509 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256470 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.256509 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-cni-bin\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.256705 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256565 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-run-netns\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.256705 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256627 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-cni-bin\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.256705 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256638 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-run\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.256705 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256660 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-tmp\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.256924 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-ovnkube-config\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.256924 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-multus-certs\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.256924 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-etc-kubernetes\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.256924 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-tmp-dir\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.257123 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.257123 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-systemd\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.257123 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.256996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.257123 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257047 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 18:53:59.257123 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.257123 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe5424b3-5c95-41a1-a9f0-ec481c863c63-serviceca\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4349e5a9-6016-4e67-85a5-7612f569236f-iptables-alerter-script\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257191 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9bca997e-1a43-4091-bf90-ca6b62edbaf9-cni-binary-copy\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-hosts-file\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257269 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l4q7\" (UniqueName: \"kubernetes.io/projected/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-kube-api-access-7l4q7\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257344 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-systemd\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-host\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-tuned\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257413 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-multus-certs\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.257453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-registration-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.257895 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257474 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-netns\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.257895 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257479 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-etc-kubernetes\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.257895 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257534 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-netns\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.257895 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257562 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.257895 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257570 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-ovnkube-config\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.257895 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257579 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.257895 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257854 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-tmp-dir\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-kubelet\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-daemon-config\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.257999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-os-release\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cni-binary-copy\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258054 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-ovn\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258085 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z54k\" (UniqueName: \"kubernetes.io/projected/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-kube-api-access-4z54k\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258074 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe5424b3-5c95-41a1-a9f0-ec481c863c63-serviceca\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-modprobe-d\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.258240 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258169 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-lib-modules\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.258718 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-systemd-units\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.258718 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-etc-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.258823 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.258823 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258727 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4349e5a9-6016-4e67-85a5-7612f569236f-iptables-alerter-script\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.258823 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258683 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-kubelet\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258338 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-hosts-file\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258267 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-host\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259196 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-etc-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259224 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-daemon-config\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259256 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-ovn\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259370 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-modprobe-d\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258623 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-systemd-units\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259437 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-registration-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259488 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.258758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-system-cni-dir\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259555 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-lib-modules\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-var-lib-kubelet\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259634 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.259730 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259674 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-env-overrides\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259689 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-var-lib-kubelet\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259734 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-os-release\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259813 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4349e5a9-6016-4e67-85a5-7612f569236f-host-slash\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259851 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-device-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259882 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9v4t\" (UniqueName: \"kubernetes.io/projected/cc2c7107-449c-492a-859d-0c0533f0f5b4-kube-api-access-m9v4t\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysconfig\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-systemd\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.259967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86658984-066d-4bd3-b244-f8164a16148d-ovn-node-metrics-cert\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260044 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-os-release\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-cni-bin\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cnibin\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260150 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-kubernetes\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.261203 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-dbus\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-kubelet\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260238 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-node-log\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260269 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-k8s-cni-cncf-io\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-cni-multus\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260356 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-hostroot\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260388 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2grk\" (UniqueName: \"kubernetes.io/projected/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-kube-api-access-q2grk\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-log-socket\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-cni-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260528 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260557 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-system-cni-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260600 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-device-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.260705 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:53:59.262280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260783 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-cni-bin\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260785 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4349e5a9-6016-4e67-85a5-7612f569236f-host-slash\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260835 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-system-cni-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghxzb\" (UniqueName: \"kubernetes.io/projected/3f06de43-8eb1-4dc4-93cd-81347784e533-kube-api-access-ghxzb\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b83fd31e-62ad-48d1-ba43-164ba56d677a-konnectivity-ca\") pod \"konnectivity-agent-pglv2\" (UID: \"b83fd31e-62ad-48d1-ba43-164ba56d677a\") " pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260915 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysctl-d\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-slash\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.260977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-socket-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-socket-dir-parent\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-conf-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghdm7\" (UniqueName: \"kubernetes.io/projected/4349e5a9-6016-4e67-85a5-7612f569236f-kube-api-access-ghdm7\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261113 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-var-lib-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh2gg\" (UniqueName: \"kubernetes.io/projected/9bca997e-1a43-4091-bf90-ca6b62edbaf9-kube-api-access-mh2gg\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261176 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-cni-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b83fd31e-62ad-48d1-ba43-164ba56d677a-agent-certs\") pod \"konnectivity-agent-pglv2\" (UID: \"b83fd31e-62ad-48d1-ba43-164ba56d677a\") " pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:53:59.263103 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-ovnkube-script-lib\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-cnibin\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261391 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-tuned\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-sys\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-kubelet-config\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261544 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-tmp\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261560 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-kubelet-config\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261605 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-log-socket\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261740 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-kubernetes\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261854 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-dbus\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261878 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysconfig\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261899 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-conf-dir\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261904 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-kubelet\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261954 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-run-systemd\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.261996 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-run-k8s-cni-cncf-io\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.263699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262000 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-etc-sysctl-d\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262081 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-host-slash\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262093 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-multus-socket-dir-parent\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262139 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-sys\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.262245 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.262250 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret podName:38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f nodeName:}" failed. No retries permitted until 2026-07-14 18:53:59.762217859 +0000 UTC m=+3.115041377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret") pod "global-pull-secret-syncer-5nq78" (UID: "38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.262432 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs podName:3f06de43-8eb1-4dc4-93cd-81347784e533 nodeName:}" failed. No retries permitted until 2026-07-14 18:53:59.762411271 +0000 UTC m=+3.115234771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs") pod "network-metrics-daemon-29qh5" (UID: "3f06de43-8eb1-4dc4-93cd-81347784e533") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262531 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-node-log\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262590 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/86658984-066d-4bd3-b244-f8164a16148d-var-lib-openvswitch\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262776 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/86658984-066d-4bd3-b244-f8164a16148d-ovnkube-script-lib\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262995 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-hostroot\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.262977 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-host-var-lib-cni-multus\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.263055 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9bca997e-1a43-4091-bf90-ca6b62edbaf9-cnibin\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.263185 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cc2c7107-449c-492a-859d-0c0533f0f5b4-socket-dir\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.264211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.263325 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b83fd31e-62ad-48d1-ba43-164ba56d677a-konnectivity-ca\") pod \"konnectivity-agent-pglv2\" (UID: \"b83fd31e-62ad-48d1-ba43-164ba56d677a\") " pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:53:59.264841 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.263401 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/86658984-066d-4bd3-b244-f8164a16148d-ovn-node-metrics-cert\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.264841 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.264646 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b83fd31e-62ad-48d1-ba43-164ba56d677a-agent-certs\") pod \"konnectivity-agent-pglv2\" (UID: \"b83fd31e-62ad-48d1-ba43-164ba56d677a\") " pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:53:59.265521 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.265499 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:53:59.265521 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.265522 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:53:59.265663 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.265533 2573 projected.go:196] Error preparing data for projected volume kube-api-access-czmbh for pod openshift-network-diagnostics/network-check-target-zg68b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:53:59.265663 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.265576 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh podName:4be3ee8d-c2cd-4795-a6cd-1a7303bfb648 nodeName:}" failed. No retries permitted until 2026-07-14 18:53:59.765565235 +0000 UTC m=+3.118388735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-czmbh" (UniqueName: "kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh") pod "network-check-target-zg68b" (UID: "4be3ee8d-c2cd-4795-a6cd-1a7303bfb648") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:53:59.265884 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.265860 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f96s7\" (UniqueName: \"kubernetes.io/projected/86658984-066d-4bd3-b244-f8164a16148d-kube-api-access-f96s7\") pod \"ovnkube-node-56nsw\" (UID: \"86658984-066d-4bd3-b244-f8164a16148d\") " pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.266543 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.266521 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l4q7\" (UniqueName: \"kubernetes.io/projected/3d421be0-d91a-41c1-b8e0-ec2205fe6be4-kube-api-access-7l4q7\") pod \"node-resolver-jbdkb\" (UID: \"3d421be0-d91a-41c1-b8e0-ec2205fe6be4\") " pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.266631 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.266581 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cj9k\" (UniqueName: \"kubernetes.io/projected/fe5424b3-5c95-41a1-a9f0-ec481c863c63-kube-api-access-9cj9k\") pod \"node-ca-qtf7j\" (UID: \"fe5424b3-5c95-41a1-a9f0-ec481c863c63\") " pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.269123 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.269098 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghxzb\" (UniqueName: \"kubernetes.io/projected/3f06de43-8eb1-4dc4-93cd-81347784e533-kube-api-access-ghxzb\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:53:59.270615 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.270588 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9v4t\" (UniqueName: \"kubernetes.io/projected/cc2c7107-449c-492a-859d-0c0533f0f5b4-kube-api-access-m9v4t\") pod \"aws-ebs-csi-driver-node-lxzpv\" (UID: \"cc2c7107-449c-492a-859d-0c0533f0f5b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.271397 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.271379 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh2gg\" (UniqueName: \"kubernetes.io/projected/9bca997e-1a43-4091-bf90-ca6b62edbaf9-kube-api-access-mh2gg\") pod \"multus-fcv5p\" (UID: \"9bca997e-1a43-4091-bf90-ca6b62edbaf9\") " pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.271697 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.271681 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2grk\" (UniqueName: \"kubernetes.io/projected/d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1-kube-api-access-q2grk\") pod \"tuned-6bdjf\" (UID: \"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1\") " pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.271888 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.271872 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghdm7\" (UniqueName: \"kubernetes.io/projected/4349e5a9-6016-4e67-85a5-7612f569236f-kube-api-access-ghdm7\") pod \"iptables-alerter-nvsrx\" (UID: \"4349e5a9-6016-4e67-85a5-7612f569236f\") " pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.353398 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.353361 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" Jul 14 18:53:59.359555 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.359534 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:53:59.362182 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362264 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-os-release\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362264 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362208 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cni-binary-copy\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362264 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362225 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z54k\" (UniqueName: \"kubernetes.io/projected/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-kube-api-access-4z54k\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362264 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-system-cni-dir\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362502 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362306 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cnibin\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362502 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362337 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362502 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362390 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-system-cni-dir\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362502 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362400 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362502 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362456 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cnibin\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362502 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362476 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-os-release\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362788 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362512 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362930 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362906 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362977 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.362906 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-cni-binary-copy\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.362977 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.362939 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2c7107_449c_492a_859d_0c0533f0f5b4.slice/crio-64a04dea4bdc9469c8f69dff40b0fbb4931e66582c412e2533891a3d297e57e8 WatchSource:0}: Error finding container 64a04dea4bdc9469c8f69dff40b0fbb4931e66582c412e2533891a3d297e57e8: Status 404 returned error can't find the container with id 64a04dea4bdc9469c8f69dff40b0fbb4931e66582c412e2533891a3d297e57e8 Jul 14 18:53:59.363151 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.363123 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.367439 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.367420 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" Jul 14 18:53:59.367640 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.367620 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83fd31e_62ad_48d1_ba43_164ba56d677a.slice/crio-5edfe9d1cf2fdd9dbed0b31cf7ae9aa33de37291334126e8bcc771ffd21f45bd WatchSource:0}: Error finding container 5edfe9d1cf2fdd9dbed0b31cf7ae9aa33de37291334126e8bcc771ffd21f45bd: Status 404 returned error can't find the container with id 5edfe9d1cf2fdd9dbed0b31cf7ae9aa33de37291334126e8bcc771ffd21f45bd Jul 14 18:53:59.372280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.372005 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:53:59.372853 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.372655 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z54k\" (UniqueName: \"kubernetes.io/projected/0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65-kube-api-access-4z54k\") pod \"multus-additional-cni-plugins-kgxnw\" (UID: \"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65\") " pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.378011 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.377986 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qtf7j" Jul 14 18:53:59.378290 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.378267 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e1eb95_034a_4a8f_9b3b_26600c1ba8e1.slice/crio-e26a5f61dbb01e4c53928db403969f403acecd5891ed2d9d5105d73af4777476 WatchSource:0}: Error finding container e26a5f61dbb01e4c53928db403969f403acecd5891ed2d9d5105d73af4777476: Status 404 returned error can't find the container with id e26a5f61dbb01e4c53928db403969f403acecd5891ed2d9d5105d73af4777476 Jul 14 18:53:59.381496 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.381476 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86658984_066d_4bd3_b244_f8164a16148d.slice/crio-b4427bc8466621b848b77bdf0cb6d412e2a4223f7bd25665e066fb25df026967 WatchSource:0}: Error finding container b4427bc8466621b848b77bdf0cb6d412e2a4223f7bd25665e066fb25df026967: Status 404 returned error can't find the container with id b4427bc8466621b848b77bdf0cb6d412e2a4223f7bd25665e066fb25df026967 Jul 14 18:53:59.383429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.383410 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fcv5p" Jul 14 18:53:59.386579 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.386558 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5424b3_5c95_41a1_a9f0_ec481c863c63.slice/crio-a3051a67c26f646f124cb8ade3c05c05058cdd74efd1b278d44a26acc5d3d10c WatchSource:0}: Error finding container a3051a67c26f646f124cb8ade3c05c05058cdd74efd1b278d44a26acc5d3d10c: Status 404 returned error can't find the container with id a3051a67c26f646f124cb8ade3c05c05058cdd74efd1b278d44a26acc5d3d10c Jul 14 18:53:59.390918 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.390899 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nvsrx" Jul 14 18:53:59.391144 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.391127 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bca997e_1a43_4091_bf90_ca6b62edbaf9.slice/crio-0f0c4382095aef192a7d8da34b119789a91906376250752d287af2aff7a020aa WatchSource:0}: Error finding container 0f0c4382095aef192a7d8da34b119789a91906376250752d287af2aff7a020aa: Status 404 returned error can't find the container with id 0f0c4382095aef192a7d8da34b119789a91906376250752d287af2aff7a020aa Jul 14 18:53:59.396495 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.396468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jbdkb" Jul 14 18:53:59.399214 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.399184 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4349e5a9_6016_4e67_85a5_7612f569236f.slice/crio-a7487713b931f7b8fbf1206742e5b867539092f6365c6fc3efd2be9f7e925193 WatchSource:0}: Error finding container a7487713b931f7b8fbf1206742e5b867539092f6365c6fc3efd2be9f7e925193: Status 404 returned error can't find the container with id a7487713b931f7b8fbf1206742e5b867539092f6365c6fc3efd2be9f7e925193 Jul 14 18:53:59.400700 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.400681 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" Jul 14 18:53:59.404423 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.404401 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d421be0_d91a_41c1_b8e0_ec2205fe6be4.slice/crio-b91f2b98bee46da5982b59101b05f10a0cca3e4682060a54263963a88c7fd2ff WatchSource:0}: Error finding container b91f2b98bee46da5982b59101b05f10a0cca3e4682060a54263963a88c7fd2ff: Status 404 returned error can't find the container with id b91f2b98bee46da5982b59101b05f10a0cca3e4682060a54263963a88c7fd2ff Jul 14 18:53:59.405935 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.405920 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:53:59.409440 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:53:59.409421 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1cbd2a_65eb_4c68_b14f_92cbb8fe5f65.slice/crio-bd54f9f83bdce93d791b1c25556752b89bb5405ab73f3173bb71c7e92cd28ac4 WatchSource:0}: Error finding container bd54f9f83bdce93d791b1c25556752b89bb5405ab73f3173bb71c7e92cd28ac4: Status 404 returned error can't find the container with id bd54f9f83bdce93d791b1c25556752b89bb5405ab73f3173bb71c7e92cd28ac4 Jul 14 18:53:59.765905 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.765808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:53:59.765905 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.765859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:53:59.766124 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.765910 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:53:59.766124 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.765975 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:53:59.766124 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.766025 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:53:59.766124 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.766057 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret podName:38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:00.766027843 +0000 UTC m=+4.118851359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret") pod "global-pull-secret-syncer-5nq78" (UID: "38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:53:59.766124 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.766083 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs podName:3f06de43-8eb1-4dc4-93cd-81347784e533 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:00.766065987 +0000 UTC m=+4.118889489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs") pod "network-metrics-daemon-29qh5" (UID: "3f06de43-8eb1-4dc4-93cd-81347784e533") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:53:59.766490 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.766183 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:53:59.766490 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.766204 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:53:59.766490 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.766219 2573 projected.go:196] Error preparing data for projected volume kube-api-access-czmbh for pod openshift-network-diagnostics/network-check-target-zg68b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:53:59.766490 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:53:59.766283 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh podName:4be3ee8d-c2cd-4795-a6cd-1a7303bfb648 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:00.766268326 +0000 UTC m=+4.119091831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-czmbh" (UniqueName: "kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh") pod "network-check-target-zg68b" (UID: "4be3ee8d-c2cd-4795-a6cd-1a7303bfb648") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:53:59.841165 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:53:59.840990 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 18:54:00.106789 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.106743 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 18:48:59 +0000 UTC" deadline="2028-04-04 21:52:10.064838668 +0000 UTC" Jul 14 18:54:00.106789 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.106785 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15122h58m9.958058102s" Jul 14 18:54:00.169760 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.169726 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:00.169951 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.169872 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:00.170337 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.170294 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:00.170441 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.170418 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:00.189887 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.189858 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pglv2" event={"ID":"b83fd31e-62ad-48d1-ba43-164ba56d677a","Type":"ContainerStarted","Data":"5edfe9d1cf2fdd9dbed0b31cf7ae9aa33de37291334126e8bcc771ffd21f45bd"} Jul 14 18:54:00.198178 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.198142 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvsrx" event={"ID":"4349e5a9-6016-4e67-85a5-7612f569236f","Type":"ContainerStarted","Data":"a7487713b931f7b8fbf1206742e5b867539092f6365c6fc3efd2be9f7e925193"} Jul 14 18:54:00.203373 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.203348 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fcv5p" event={"ID":"9bca997e-1a43-4091-bf90-ca6b62edbaf9","Type":"ContainerStarted","Data":"0f0c4382095aef192a7d8da34b119789a91906376250752d287af2aff7a020aa"} Jul 14 18:54:00.221907 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.221821 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qtf7j" event={"ID":"fe5424b3-5c95-41a1-a9f0-ec481c863c63","Type":"ContainerStarted","Data":"a3051a67c26f646f124cb8ade3c05c05058cdd74efd1b278d44a26acc5d3d10c"} Jul 14 18:54:00.233362 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.233338 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"b4427bc8466621b848b77bdf0cb6d412e2a4223f7bd25665e066fb25df026967"} Jul 14 18:54:00.245478 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.245427 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" event={"ID":"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1","Type":"ContainerStarted","Data":"e26a5f61dbb01e4c53928db403969f403acecd5891ed2d9d5105d73af4777476"} Jul 14 18:54:00.250254 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.250221 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" event={"ID":"cc2c7107-449c-492a-859d-0c0533f0f5b4","Type":"ContainerStarted","Data":"64a04dea4bdc9469c8f69dff40b0fbb4931e66582c412e2533891a3d297e57e8"} Jul 14 18:54:00.262801 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.262765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerStarted","Data":"bd54f9f83bdce93d791b1c25556752b89bb5405ab73f3173bb71c7e92cd28ac4"} Jul 14 18:54:00.275706 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.275496 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jbdkb" event={"ID":"3d421be0-d91a-41c1-b8e0-ec2205fe6be4","Type":"ContainerStarted","Data":"b91f2b98bee46da5982b59101b05f10a0cca3e4682060a54263963a88c7fd2ff"} Jul 14 18:54:00.776408 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.776365 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:00.776590 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.776421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:00.776590 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:00.776472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:00.776720 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.776626 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:00.776720 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.776690 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs podName:3f06de43-8eb1-4dc4-93cd-81347784e533 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:02.776672225 +0000 UTC m=+6.129495744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs") pod "network-metrics-daemon-29qh5" (UID: "3f06de43-8eb1-4dc4-93cd-81347784e533") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:00.777611 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.777112 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:00.777611 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.777171 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret podName:38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:02.77715554 +0000 UTC m=+6.129979060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret") pod "global-pull-secret-syncer-5nq78" (UID: "38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:00.777611 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.777256 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:00.777611 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.777272 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:00.777611 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.777286 2573 projected.go:196] Error preparing data for projected volume kube-api-access-czmbh for pod openshift-network-diagnostics/network-check-target-zg68b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:00.777611 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:00.777338 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh podName:4be3ee8d-c2cd-4795-a6cd-1a7303bfb648 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:02.777310864 +0000 UTC m=+6.130134383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-czmbh" (UniqueName: "kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh") pod "network-check-target-zg68b" (UID: "4be3ee8d-c2cd-4795-a6cd-1a7303bfb648") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:01.107545 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:01.107494 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 18:48:59 +0000 UTC" deadline="2028-04-14 18:17:23.110022686 +0000 UTC" Jul 14 18:54:01.107545 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:01.107543 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15359h23m22.002485247s" Jul 14 18:54:01.170777 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:01.170741 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:01.170962 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:01.170885 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:02.170010 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:02.169750 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:02.170519 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.170140 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:02.170519 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:02.169991 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:02.170519 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.170251 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:02.797553 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:02.797485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:02.797755 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:02.797600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:02.797755 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:02.797632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:02.797865 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.797792 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:02.797865 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.797811 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:02.797865 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.797825 2573 projected.go:196] Error preparing data for projected volume kube-api-access-czmbh for pod openshift-network-diagnostics/network-check-target-zg68b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:02.798016 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.797889 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh podName:4be3ee8d-c2cd-4795-a6cd-1a7303bfb648 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:06.797868895 +0000 UTC m=+10.150692417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-czmbh" (UniqueName: "kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh") pod "network-check-target-zg68b" (UID: "4be3ee8d-c2cd-4795-a6cd-1a7303bfb648") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:02.798389 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.798370 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:02.798480 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.798430 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs podName:3f06de43-8eb1-4dc4-93cd-81347784e533 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:06.798413686 +0000 UTC m=+10.151237193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs") pod "network-metrics-daemon-29qh5" (UID: "3f06de43-8eb1-4dc4-93cd-81347784e533") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:02.798554 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.798490 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:02.798554 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:02.798522 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret podName:38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:06.798511057 +0000 UTC m=+10.151334563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret") pod "global-pull-secret-syncer-5nq78" (UID: "38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:03.170946 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:03.170390 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:03.170946 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:03.170519 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:04.170479 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:04.170438 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:04.170661 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:04.170591 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:04.170661 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:04.170449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:04.170794 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:04.170774 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:05.170435 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:05.170404 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:05.170921 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:05.170547 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:06.170048 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:06.169753 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:06.170048 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.169917 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:06.170322 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:06.169762 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:06.170459 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.170413 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:06.834399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:06.834489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:06.834519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.834538 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.834607 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs podName:3f06de43-8eb1-4dc4-93cd-81347784e533 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:14.834588358 +0000 UTC m=+18.187411880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs") pod "network-metrics-daemon-29qh5" (UID: "3f06de43-8eb1-4dc4-93cd-81347784e533") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.834617 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.834632 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.834643 2573 projected.go:196] Error preparing data for projected volume kube-api-access-czmbh for pod openshift-network-diagnostics/network-check-target-zg68b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.834652 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.834681 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh podName:4be3ee8d-c2cd-4795-a6cd-1a7303bfb648 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:14.834669302 +0000 UTC m=+18.187492805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-czmbh" (UniqueName: "kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh") pod "network-check-target-zg68b" (UID: "4be3ee8d-c2cd-4795-a6cd-1a7303bfb648") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:06.834709 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:06.834724 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret podName:38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:14.83470432 +0000 UTC m=+18.187527822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret") pod "global-pull-secret-syncer-5nq78" (UID: "38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:07.170691 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:07.170594 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:07.171129 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:07.170704 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:08.169649 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:08.169616 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:08.169808 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:08.169663 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:08.169808 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:08.169761 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:08.169953 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:08.169925 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:09.169951 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:09.169917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:09.170405 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:09.170036 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:10.170168 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:10.170130 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:10.170707 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:10.170174 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:10.170707 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:10.170281 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:10.170707 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:10.170379 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:11.169948 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:11.169912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:11.170138 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:11.170024 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:12.169597 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:12.169550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:12.170030 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:12.169688 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:12.170030 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:12.169738 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:12.170030 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:12.169848 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:13.170489 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:13.170453 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:13.170917 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:13.170591 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:14.169834 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:14.169797 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:14.169834 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:14.169835 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:14.170056 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.169915 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:14.170056 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.169984 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:14.895472 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:14.895440 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:14.895480 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:14.895519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.895595 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.895637 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.895646 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.895656 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.895670 2573 projected.go:196] Error preparing data for projected volume kube-api-access-czmbh for pod openshift-network-diagnostics/network-check-target-zg68b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.895671 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret podName:38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f nodeName:}" failed. No retries permitted until 2026-07-14 18:54:30.895652855 +0000 UTC m=+34.248476374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret") pod "global-pull-secret-syncer-5nq78" (UID: "38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.895718 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs podName:3f06de43-8eb1-4dc4-93cd-81347784e533 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:30.895706975 +0000 UTC m=+34.248530480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs") pod "network-metrics-daemon-29qh5" (UID: "3f06de43-8eb1-4dc4-93cd-81347784e533") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:14.896040 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:14.895732 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh podName:4be3ee8d-c2cd-4795-a6cd-1a7303bfb648 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:30.895724505 +0000 UTC m=+34.248548010 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-czmbh" (UniqueName: "kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh") pod "network-check-target-zg68b" (UID: "4be3ee8d-c2cd-4795-a6cd-1a7303bfb648") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:15.169797 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:15.169701 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:15.169954 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:15.169855 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:16.169467 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:16.169435 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:16.169943 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:16.169572 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:16.169943 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:16.169633 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:16.169943 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:16.169760 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:17.170794 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:17.170761 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:17.171195 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:17.170877 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:18.169929 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:18.169887 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:18.170099 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:18.169934 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:18.170099 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:18.170013 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:18.170219 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:18.170152 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:19.169917 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:19.169888 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:19.170390 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:19.170008 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:20.170154 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.169911 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:20.170573 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:20.170303 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:20.170635 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.169919 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:20.170756 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:20.170731 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:20.319075 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.319043 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" event={"ID":"b4ea88a121a641dae990504772a5f753","Type":"ContainerStarted","Data":"36befbdbdda71c0ef4ae48fdd0773dfb6d1a0e9d511ad62358f159cb6f755735"} Jul 14 18:54:20.320901 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.320843 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerStarted","Data":"4bdbc61f308917e57c3a54dfa248f8bf79cb18a3329845876db477765a2f9db4"} Jul 14 18:54:20.322511 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.322482 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jbdkb" event={"ID":"3d421be0-d91a-41c1-b8e0-ec2205fe6be4","Type":"ContainerStarted","Data":"6cb263ebb2f2c9bb24e3d35c2fa1c48f916a8edbb2a6767e034dcdab1f2cd05f"} Jul 14 18:54:20.324260 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.324178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pglv2" event={"ID":"b83fd31e-62ad-48d1-ba43-164ba56d677a","Type":"ContainerStarted","Data":"396eaa0f854338fa05ba6124b84a842ee5ce43c5799786c4d2e9ab484af93184"} Jul 14 18:54:20.325903 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.325882 2573 generic.go:356] "Generic (PLEG): container finished" podID="85f1899aaa44e5cf0afd9d7f08b383f4" containerID="6ffd534e516e142ed2d6caef7ad40ffecab2491b5ab743c6f3657d8b2d35d7c7" exitCode=0 Jul 14 18:54:20.325983 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.325955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"85f1899aaa44e5cf0afd9d7f08b383f4","Type":"ContainerDied","Data":"6ffd534e516e142ed2d6caef7ad40ffecab2491b5ab743c6f3657d8b2d35d7c7"} Jul 14 18:54:20.327505 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.327482 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fcv5p" event={"ID":"9bca997e-1a43-4091-bf90-ca6b62edbaf9","Type":"ContainerStarted","Data":"e9ce8ea18e2dfcc659ce70b7a01118bf9acddd23db8394255a84801f5886313c"} Jul 14 18:54:20.329124 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.329094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qtf7j" event={"ID":"fe5424b3-5c95-41a1-a9f0-ec481c863c63","Type":"ContainerStarted","Data":"140535764c94bb6055bd658af15287eca2020e3b40238b2fa1ddb048e51630e5"} Jul 14 18:54:20.330659 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.330641 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 18:54:20.331027 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.331009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"4ddfc01bcfec58c71c229ccbd6faad9d08846ef58527aa1bf1a91a72751fa236"} Jul 14 18:54:20.331134 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.331116 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"84fd4feef708b715306b2f353051d926263a4053edd51d7360e402bb827ce518"} Jul 14 18:54:20.332460 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.332441 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" event={"ID":"d3e1eb95-034a-4a8f-9b3b-26600c1ba8e1","Type":"ContainerStarted","Data":"c342331e21eaf42494a93859cf227af4c95a225a2a0821949bbf4841941358dd"} Jul 14 18:54:20.333884 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.333864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" event={"ID":"cc2c7107-449c-492a-859d-0c0533f0f5b4","Type":"ContainerStarted","Data":"a6da142dee3475141b36a642ced92edc897dbe501cc7c205e676a8ce48f41de4"} Jul 14 18:54:20.381497 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.381457 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fcv5p" podStartSLOduration=1.917075651 podStartE2EDuration="22.381445446s" totalImagesPullingTime="20.464369795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:20.366023531 +0000 UTC m=+23.718847059" watchObservedRunningTime="2026-07-14 18:54:20.381445446 +0000 UTC m=+23.734268966" Jul 14 18:54:20.381629 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.381597 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jbdkb" podStartSLOduration=1.9643829099999999 podStartE2EDuration="22.381593632s" totalImagesPullingTime="20.417210722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:20.381406702 +0000 UTC m=+23.734230225" watchObservedRunningTime="2026-07-14 18:54:20.381593632 +0000 UTC m=+23.734417152" Jul 14 18:54:20.397704 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.397664 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pglv2" podStartSLOduration=3.132922025 podStartE2EDuration="23.397655463s" totalImagesPullingTime="20.264733438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:53:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:20.397568538 +0000 UTC m=+23.750392059" watchObservedRunningTime="2026-07-14 18:54:20.397655463 +0000 UTC m=+23.750478984" Jul 14 18:54:20.416823 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.416782 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6bdjf" podStartSLOduration=1.9734719969999999 podStartE2EDuration="22.416773055s" totalImagesPullingTime="20.443301058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:20.416314339 +0000 UTC m=+23.769137879" watchObservedRunningTime="2026-07-14 18:54:20.416773055 +0000 UTC m=+23.769596576" Jul 14 18:54:20.429829 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:20.429792 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" podStartSLOduration=21.429777706 podStartE2EDuration="21.429777706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:20.429763033 +0000 UTC m=+23.782586555" watchObservedRunningTime="2026-07-14 18:54:20.429777706 +0000 UTC m=+23.782601228" Jul 14 18:54:21.170663 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.170355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:21.171543 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:21.170726 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:21.337845 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.337820 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 18:54:21.338173 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.338145 2573 generic.go:356] "Generic (PLEG): container finished" podID="86658984-066d-4bd3-b244-f8164a16148d" containerID="4ddfc01bcfec58c71c229ccbd6faad9d08846ef58527aa1bf1a91a72751fa236" exitCode=1 Jul 14 18:54:21.338251 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.338217 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerDied","Data":"4ddfc01bcfec58c71c229ccbd6faad9d08846ef58527aa1bf1a91a72751fa236"} Jul 14 18:54:21.338320 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.338305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"81de3820dbcc6e437c4ba39d85eda71c827b6489e64c0538adfd81efc77f7fe8"} Jul 14 18:54:21.338375 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.338337 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"162a5ccc2fb34370442f52b27ffdba3efc6b69c308f982c95cbd40bd0ad6314f"} Jul 14 18:54:21.338375 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.338364 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"5136e40b406867f0d706d8247fcb6b5453c75ad6fe709c5b2ba31a5d1846077e"} Jul 14 18:54:21.338466 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.338390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"bb7af9389cfac2057657b05d6fa579c4291c5d28910802f25d0ddbe3a53c8021"} Jul 14 18:54:21.339530 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.339502 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65" containerID="4bdbc61f308917e57c3a54dfa248f8bf79cb18a3329845876db477765a2f9db4" exitCode=0 Jul 14 18:54:21.339648 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.339531 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerDied","Data":"4bdbc61f308917e57c3a54dfa248f8bf79cb18a3329845876db477765a2f9db4"} Jul 14 18:54:21.358684 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.358644 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qtf7j" podStartSLOduration=3.113047481 podStartE2EDuration="23.358630905s" totalImagesPullingTime="20.245583424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:20.451896099 +0000 UTC m=+23.804719621" watchObservedRunningTime="2026-07-14 18:54:21.358630905 +0000 UTC m=+24.711454425" Jul 14 18:54:21.624310 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.624285 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:54:21.624898 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.624882 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:54:21.686835 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:21.686815 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 18:54:22.124967 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.124874 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T18:54:21.686830623Z","UUID":"63ac6e69-f1d6-4a7f-99f4-a96cd433578c","Handler":null,"Name":"","Endpoint":""} Jul 14 18:54:22.126715 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.126690 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 18:54:22.126862 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.126735 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 18:54:22.170412 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.170386 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:22.170557 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.170391 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:22.170557 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:22.170509 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:22.170670 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:22.170578 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:22.344192 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.344158 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" event={"ID":"cc2c7107-449c-492a-859d-0c0533f0f5b4","Type":"ContainerStarted","Data":"92ee5d76bced011e13df28f29acb0c28dba6413cbb49d95158969ed0308ad933"} Jul 14 18:54:22.346327 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.346303 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"85f1899aaa44e5cf0afd9d7f08b383f4","Type":"ContainerStarted","Data":"101c73730aa231c24de95a08447d022ff16344a6b71a4a3ec1ba26f1f0b50097"} Jul 14 18:54:22.348038 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.348015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nvsrx" event={"ID":"4349e5a9-6016-4e67-85a5-7612f569236f","Type":"ContainerStarted","Data":"4f7c02d9dc2708d30d347f063b7abd3ce58ca18cbdf6df737b001ca4e9a3d9d3"} Jul 14 18:54:22.348354 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.348334 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:54:22.348711 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.348692 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pglv2" Jul 14 18:54:22.362560 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.362512 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" podStartSLOduration=23.362495177 podStartE2EDuration="23.362495177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:22.362113989 +0000 UTC m=+25.714937509" watchObservedRunningTime="2026-07-14 18:54:22.362495177 +0000 UTC m=+25.715318698" Jul 14 18:54:22.392812 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:22.392736 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nvsrx" podStartSLOduration=4.159479831 podStartE2EDuration="24.392722937s" totalImagesPullingTime="20.233243106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:22.392543556 +0000 UTC m=+25.745367079" watchObservedRunningTime="2026-07-14 18:54:22.392722937 +0000 UTC m=+25.745546458" Jul 14 18:54:23.170341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:23.170080 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:23.170513 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:23.170397 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:23.353934 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:23.353909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 18:54:23.354421 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:23.354396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"cbae9350241bf00e049e2d68679c364d97d48362f3677cb88209946a57e64fa6"} Jul 14 18:54:23.356772 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:23.356744 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" event={"ID":"cc2c7107-449c-492a-859d-0c0533f0f5b4","Type":"ContainerStarted","Data":"da801c37b80548449d26be8ea08ad93acfcf92741214414f0b8b6c41598f63b8"} Jul 14 18:54:24.170406 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:24.170368 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:24.170688 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:24.170472 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:24.170688 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:24.170534 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:24.170688 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:24.170656 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:24.378385 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:24.378330 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lxzpv" podStartSLOduration=4.280240997 podStartE2EDuration="27.37831069s" totalImagesPullingTime="23.098069693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:24.377651048 +0000 UTC m=+27.730474569" watchObservedRunningTime="2026-07-14 18:54:24.37831069 +0000 UTC m=+27.731134213" Jul 14 18:54:25.173830 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:25.173802 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:25.173989 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:25.173923 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:26.170228 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.170009 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:26.170802 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.170067 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:26.170802 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:26.170317 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:26.170802 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:26.170338 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:26.365073 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.365037 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65" containerID="d2f8e3e88208ad1436f8a8044f331d5815f95a6d94ae73082057d23bce9e22d3" exitCode=0 Jul 14 18:54:26.365259 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.365130 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerDied","Data":"d2f8e3e88208ad1436f8a8044f331d5815f95a6d94ae73082057d23bce9e22d3"} Jul 14 18:54:26.368855 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.368838 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 18:54:26.369195 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.369177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"b73834c77bd3bc69495036b7d7048571afcef4d1c57455af50e856c129b3e679"} Jul 14 18:54:26.369395 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.369382 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:54:26.369473 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.369421 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:54:26.369618 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.369600 2573 scope.go:117] "RemoveContainer" containerID="4ddfc01bcfec58c71c229ccbd6faad9d08846ef58527aa1bf1a91a72751fa236" Jul 14 18:54:26.385895 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:26.385874 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:54:27.174846 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.174818 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:27.175396 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:27.174907 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:27.374245 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.374219 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 18:54:27.374594 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.374571 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" event={"ID":"86658984-066d-4bd3-b244-f8164a16148d","Type":"ContainerStarted","Data":"97b0bee09a453642a019d9621d0af012c270b5753d41fd6f2c88edb70e054807"} Jul 14 18:54:27.374822 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.374797 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:54:27.388982 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.388963 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:54:27.404472 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.404433 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" podStartSLOduration=8.750157522 podStartE2EDuration="29.404420436s" totalImagesPullingTime="20.654262914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:27.403271858 +0000 UTC m=+30.756095400" watchObservedRunningTime="2026-07-14 18:54:27.404420436 +0000 UTC m=+30.757243957" Jul 14 18:54:27.928770 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.928552 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5nq78"] Jul 14 18:54:27.928926 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.928853 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:27.928965 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:27.928938 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:27.936655 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.936629 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zg68b"] Jul 14 18:54:27.936796 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.936722 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:27.936863 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:27.936821 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:27.937470 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.937448 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-29qh5"] Jul 14 18:54:27.937570 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:27.937558 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:27.937687 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:27.937663 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:28.378758 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:28.378717 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65" containerID="6f0e17a54aab7152ba2a21b093ef6ee2b931205a041209372cbbd0748b0d7455" exitCode=0 Jul 14 18:54:28.379120 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:28.378799 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerDied","Data":"6f0e17a54aab7152ba2a21b093ef6ee2b931205a041209372cbbd0748b0d7455"} Jul 14 18:54:29.170140 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:29.170113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:29.170289 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:29.170113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:29.170289 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:29.170271 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:29.170409 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:29.170332 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:30.169520 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:30.169498 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:30.170173 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.169591 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:30.385763 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:30.385675 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65" containerID="298613e86eb3a7423ed9493cf753761b8d450e7376c6ad86546ac5aae6b7146b" exitCode=0 Jul 14 18:54:30.385763 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:30.385738 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerDied","Data":"298613e86eb3a7423ed9493cf753761b8d450e7376c6ad86546ac5aae6b7146b"} Jul 14 18:54:30.912269 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:30.912221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:30.912457 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:30.912282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:30.912457 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:30.912324 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:30.912457 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.912371 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:30.912457 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.912440 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 18:54:30.912457 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.912457 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 18:54:30.912708 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.912468 2573 projected.go:196] Error preparing data for projected volume kube-api-access-czmbh for pod openshift-network-diagnostics/network-check-target-zg68b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:30.912708 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.912441 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:30.912708 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.912445 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret podName:38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f nodeName:}" failed. No retries permitted until 2026-07-14 18:55:02.912425537 +0000 UTC m=+66.265249051 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret") pod "global-pull-secret-syncer-5nq78" (UID: "38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f") : object "kube-system"/"original-pull-secret" not registered Jul 14 18:54:30.912708 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.912538 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh podName:4be3ee8d-c2cd-4795-a6cd-1a7303bfb648 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:02.912525492 +0000 UTC m=+66.265348996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-czmbh" (UniqueName: "kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh") pod "network-check-target-zg68b" (UID: "4be3ee8d-c2cd-4795-a6cd-1a7303bfb648") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 18:54:30.912708 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:30.912552 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs podName:3f06de43-8eb1-4dc4-93cd-81347784e533 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:02.912543303 +0000 UTC m=+66.265366808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs") pod "network-metrics-daemon-29qh5" (UID: "3f06de43-8eb1-4dc4-93cd-81347784e533") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 18:54:31.169920 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:31.169839 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:31.170312 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:31.169960 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:31.170312 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:31.170016 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:31.170312 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:31.170141 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:32.169875 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:32.169841 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:32.170047 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:32.169947 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zg68b" podUID="4be3ee8d-c2cd-4795-a6cd-1a7303bfb648" Jul 14 18:54:33.169854 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:33.169820 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:33.170045 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:33.169969 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-29qh5" podUID="3f06de43-8eb1-4dc4-93cd-81347784e533" Jul 14 18:54:33.170045 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:33.170007 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:33.170438 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:33.170080 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5nq78" podUID="38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f" Jul 14 18:54:33.967226 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:33.967191 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeReady" Jul 14 18:54:33.967428 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:33.967361 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 18:54:34.006585 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.006557 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78f6c8468c-kpmzn"] Jul 14 18:54:34.010827 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.010809 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.013386 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.013364 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 18:54:34.013689 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.013639 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 18:54:34.013812 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.013794 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 18:54:34.013878 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.013798 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s87bq\"" Jul 14 18:54:34.019474 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.019313 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 18:54:34.023422 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.023402 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4wpdm"] Jul 14 18:54:34.026533 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.026512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.027865 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.027841 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f6c8468c-kpmzn"] Jul 14 18:54:34.029257 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.029076 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p5svp\"" Jul 14 18:54:34.029257 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.029077 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 18:54:34.029257 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.029077 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 18:54:34.030750 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.030729 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mrx77"] Jul 14 18:54:34.033789 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.033767 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mrx77" Jul 14 18:54:34.036881 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.036860 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 18:54:34.037183 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.036876 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 18:54:34.039250 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.036891 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x2zbd\"" Jul 14 18:54:34.039250 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.036911 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 18:54:34.050907 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.050887 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mrx77"] Jul 14 18:54:34.051793 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.051771 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4wpdm"] Jul 14 18:54:34.139473 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139422 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.139662 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139480 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-trusted-ca\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.139662 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46sn2\" (UniqueName: \"kubernetes.io/projected/99a6be85-dd78-4145-910f-50e264877d17-kube-api-access-46sn2\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.139662 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4qll\" (UniqueName: \"kubernetes.io/projected/750a0fb6-f2ad-41b9-a9a9-a2fca77081c4-kube-api-access-v4qll\") pod \"ingress-canary-mrx77\" (UID: \"750a0fb6-f2ad-41b9-a9a9-a2fca77081c4\") " pod="openshift-ingress-canary/ingress-canary-mrx77" Jul 14 18:54:34.139662 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99a6be85-dd78-4145-910f-50e264877d17-config-volume\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.139879 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139692 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-ca-trust-extracted\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.139879 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139726 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-bound-sa-token\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.139879 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.139879 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139776 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750a0fb6-f2ad-41b9-a9a9-a2fca77081c4-cert\") pod \"ingress-canary-mrx77\" (UID: \"750a0fb6-f2ad-41b9-a9a9-a2fca77081c4\") " pod="openshift-ingress-canary/ingress-canary-mrx77" Jul 14 18:54:34.139879 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-image-registry-private-configuration\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.139879 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139832 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99a6be85-dd78-4145-910f-50e264877d17-tmp-dir\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.140165 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139886 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-installation-pull-secrets\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.140165 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139940 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whls4\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-kube-api-access-whls4\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.140165 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.139971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-certificates\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.169620 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.169441 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:54:34.172339 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.172310 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 18:54:34.172710 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.172400 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zn8zd\"" Jul 14 18:54:34.172710 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.172408 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 18:54:34.176712 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.176684 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:34.240782 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.240709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99a6be85-dd78-4145-910f-50e264877d17-config-volume\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.240782 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.240756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-ca-trust-extracted\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.240983 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.240893 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-bound-sa-token\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.240983 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.240935 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.240983 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.240964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750a0fb6-f2ad-41b9-a9a9-a2fca77081c4-cert\") pod \"ingress-canary-mrx77\" (UID: \"750a0fb6-f2ad-41b9-a9a9-a2fca77081c4\") " pod="openshift-ingress-canary/ingress-canary-mrx77" Jul 14 18:54:34.241135 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.241060 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 18:54:34.241135 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.241125 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls podName:99a6be85-dd78-4145-910f-50e264877d17 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:34.741103794 +0000 UTC m=+38.093927304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls") pod "dns-default-4wpdm" (UID: "99a6be85-dd78-4145-910f-50e264877d17") : secret "dns-default-metrics-tls" not found Jul 14 18:54:34.241255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241160 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-ca-trust-extracted\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.241255 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-image-registry-private-configuration\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.241365 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99a6be85-dd78-4145-910f-50e264877d17-tmp-dir\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.241365 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-installation-pull-secrets\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.241465 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whls4\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-kube-api-access-whls4\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.241465 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241411 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99a6be85-dd78-4145-910f-50e264877d17-config-volume\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.241465 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-certificates\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.241465 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.241655 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241478 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-trusted-ca\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.241655 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46sn2\" (UniqueName: \"kubernetes.io/projected/99a6be85-dd78-4145-910f-50e264877d17-kube-api-access-46sn2\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.241655 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241528 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4qll\" (UniqueName: \"kubernetes.io/projected/750a0fb6-f2ad-41b9-a9a9-a2fca77081c4-kube-api-access-v4qll\") pod \"ingress-canary-mrx77\" (UID: \"750a0fb6-f2ad-41b9-a9a9-a2fca77081c4\") " pod="openshift-ingress-canary/ingress-canary-mrx77" Jul 14 18:54:34.241655 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.241547 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99a6be85-dd78-4145-910f-50e264877d17-tmp-dir\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.241655 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.241574 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 18:54:34.241655 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.241589 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f6c8468c-kpmzn: secret "image-registry-tls" not found Jul 14 18:54:34.241655 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.241644 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls podName:4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:34.741626852 +0000 UTC m=+38.094450365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls") pod "image-registry-78f6c8468c-kpmzn" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d") : secret "image-registry-tls" not found Jul 14 18:54:34.242118 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.242098 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-certificates\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.242463 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.242439 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-trusted-ca\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.245700 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.245658 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-installation-pull-secrets\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.245700 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.245666 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-image-registry-private-configuration\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.245835 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.245815 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/750a0fb6-f2ad-41b9-a9a9-a2fca77081c4-cert\") pod \"ingress-canary-mrx77\" (UID: \"750a0fb6-f2ad-41b9-a9a9-a2fca77081c4\") " pod="openshift-ingress-canary/ingress-canary-mrx77" Jul 14 18:54:34.253453 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.253427 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46sn2\" (UniqueName: \"kubernetes.io/projected/99a6be85-dd78-4145-910f-50e264877d17-kube-api-access-46sn2\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.253791 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.253765 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whls4\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-kube-api-access-whls4\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.254889 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.254837 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-bound-sa-token\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.255132 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.255113 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4qll\" (UniqueName: \"kubernetes.io/projected/750a0fb6-f2ad-41b9-a9a9-a2fca77081c4-kube-api-access-v4qll\") pod \"ingress-canary-mrx77\" (UID: \"750a0fb6-f2ad-41b9-a9a9-a2fca77081c4\") " pod="openshift-ingress-canary/ingress-canary-mrx77" Jul 14 18:54:34.346601 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.346565 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mrx77" Jul 14 18:54:34.507573 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.507543 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mrx77"] Jul 14 18:54:34.512571 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:34.512536 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750a0fb6_f2ad_41b9_a9a9_a2fca77081c4.slice/crio-9592af79f3bc2d9fd2c6a38f88af1fe2c73c3f631ccba2127443e3d95849a0c7 WatchSource:0}: Error finding container 9592af79f3bc2d9fd2c6a38f88af1fe2c73c3f631ccba2127443e3d95849a0c7: Status 404 returned error can't find the container with id 9592af79f3bc2d9fd2c6a38f88af1fe2c73c3f631ccba2127443e3d95849a0c7 Jul 14 18:54:34.745335 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.745296 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:34.745483 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:34.745399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:34.745483 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.745439 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 18:54:34.745607 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.745503 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls podName:99a6be85-dd78-4145-910f-50e264877d17 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:35.745488079 +0000 UTC m=+39.098311578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls") pod "dns-default-4wpdm" (UID: "99a6be85-dd78-4145-910f-50e264877d17") : secret "dns-default-metrics-tls" not found Jul 14 18:54:34.745607 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.745508 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 18:54:34.745607 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.745522 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f6c8468c-kpmzn: secret "image-registry-tls" not found Jul 14 18:54:34.745607 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:34.745577 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls podName:4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:35.745562125 +0000 UTC m=+39.098385638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls") pod "image-registry-78f6c8468c-kpmzn" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d") : secret "image-registry-tls" not found Jul 14 18:54:35.169887 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.169849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:54:35.170077 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.170050 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:54:35.172630 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.172606 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 18:54:35.173286 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.173268 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltzph\"" Jul 14 18:54:35.173359 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.173296 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 18:54:35.398108 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.398072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mrx77" event={"ID":"750a0fb6-f2ad-41b9-a9a9-a2fca77081c4","Type":"ContainerStarted","Data":"9592af79f3bc2d9fd2c6a38f88af1fe2c73c3f631ccba2127443e3d95849a0c7"} Jul 14 18:54:35.400721 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.400694 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65" containerID="453fc0432338bd83f816948bba167eb1a0056b00f0241a89e0c78dfc656b66be" exitCode=0 Jul 14 18:54:35.400843 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.400731 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerDied","Data":"453fc0432338bd83f816948bba167eb1a0056b00f0241a89e0c78dfc656b66be"} Jul 14 18:54:35.643773 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.643727 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:35.753998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.753924 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:35.753998 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:35.753979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:35.754176 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:35.754082 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 18:54:35.754176 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:35.754091 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 18:54:35.754176 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:35.754148 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls podName:99a6be85-dd78-4145-910f-50e264877d17 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:37.754133986 +0000 UTC m=+41.106957489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls") pod "dns-default-4wpdm" (UID: "99a6be85-dd78-4145-910f-50e264877d17") : secret "dns-default-metrics-tls" not found Jul 14 18:54:35.754176 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:35.754100 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f6c8468c-kpmzn: secret "image-registry-tls" not found Jul 14 18:54:35.754336 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:35.754222 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls podName:4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:37.7542062 +0000 UTC m=+41.107029702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls") pod "image-registry-78f6c8468c-kpmzn" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d") : secret "image-registry-tls" not found Jul 14 18:54:36.266437 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.266395 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8"] Jul 14 18:54:36.269319 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.269255 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.271161 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.271019 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72"] Jul 14 18:54:36.272029 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.272000 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 18:54:36.272182 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.272007 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6f2jc\"" Jul 14 18:54:36.273985 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.273955 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-skc5m"] Jul 14 18:54:36.274093 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.274073 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:36.275065 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.275043 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 18:54:36.275171 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.275078 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 18:54:36.275171 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.275096 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 18:54:36.276737 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.276720 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.276990 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.276968 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 18:54:36.277123 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.277103 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 18:54:36.277217 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.277129 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:54:36.277407 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.277388 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qklgj\"" Jul 14 18:54:36.278800 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.278781 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 14 18:54:36.280014 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.279950 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rx56n\"" Jul 14 18:54:36.280281 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.280261 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 18:54:36.280492 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.280473 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 14 18:54:36.280996 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.280964 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 18:54:36.282756 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.282738 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8"] Jul 14 18:54:36.285136 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.285089 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-skc5m"] Jul 14 18:54:36.285227 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.285171 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 14 18:54:36.289887 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.289865 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72"] Jul 14 18:54:36.358969 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.358924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23510c14-feb5-41ec-8400-8f8fbd8df57e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.359117 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23510c14-feb5-41ec-8400-8f8fbd8df57e-tmp\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.359117 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.359117 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/23510c14-feb5-41ec-8400-8f8fbd8df57e-snapshots\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.359284 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359130 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23510c14-feb5-41ec-8400-8f8fbd8df57e-serving-cert\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.359284 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359170 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2lm7\" (UniqueName: \"kubernetes.io/projected/6b56f683-6467-45f5-b97a-68515cfe1abe-kube-api-access-m2lm7\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:36.359284 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.359284 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4k6d\" (UniqueName: \"kubernetes.io/projected/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-kube-api-access-k4k6d\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.359435 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23510c14-feb5-41ec-8400-8f8fbd8df57e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.359435 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8jnc\" (UniqueName: \"kubernetes.io/projected/23510c14-feb5-41ec-8400-8f8fbd8df57e-kube-api-access-k8jnc\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.359512 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.359438 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:36.371097 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.371075 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722"] Jul 14 18:54:36.375578 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.375554 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m"] Jul 14 18:54:36.375704 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.375689 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.378373 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.378346 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 18:54:36.378373 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.378361 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 18:54:36.378537 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.378412 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nxpgk\"" Jul 14 18:54:36.378537 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.378487 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 18:54:36.378750 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.378685 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:54:36.381582 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.381562 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b9c76f644-m2sfm"] Jul 14 18:54:36.381691 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.381677 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.383878 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.383858 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 14 18:54:36.383878 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.383862 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:54:36.384030 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.384005 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 14 18:54:36.384311 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.384219 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-n8npp\"" Jul 14 18:54:36.384883 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.384864 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 14 18:54:36.385765 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.385732 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.387812 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.387796 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mc87v\"" Jul 14 18:54:36.390151 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.390131 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 18:54:36.390275 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.390225 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 18:54:36.390382 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.390139 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 18:54:36.390860 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.390565 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 18:54:36.390860 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.390620 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 18:54:36.390860 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.390744 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 18:54:36.392410 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.392320 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722"] Jul 14 18:54:36.393583 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.393562 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m"] Jul 14 18:54:36.394380 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.394360 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b9c76f644-m2sfm"] Jul 14 18:54:36.411024 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.410995 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65" containerID="10b2b7729d626af74262816d8306fc20fdadfc14109f7d5c965a86d46383ec59" exitCode=0 Jul 14 18:54:36.411133 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.411037 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerDied","Data":"10b2b7729d626af74262816d8306fc20fdadfc14109f7d5c965a86d46383ec59"} Jul 14 18:54:36.460186 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8jnc\" (UniqueName: \"kubernetes.io/projected/23510c14-feb5-41ec-8400-8f8fbd8df57e-kube-api-access-k8jnc\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.460369 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s596m\" (UniqueName: \"kubernetes.io/projected/fec65f74-94ce-4780-ba9d-a4230023f010-kube-api-access-s596m\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.460369 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460267 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23510c14-feb5-41ec-8400-8f8fbd8df57e-tmp\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.460369 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460303 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.460369 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2lm7\" (UniqueName: \"kubernetes.io/projected/6b56f683-6467-45f5-b97a-68515cfe1abe-kube-api-access-m2lm7\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:36.460575 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4k6d\" (UniqueName: \"kubernetes.io/projected/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-kube-api-access-k4k6d\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.460575 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:36.460575 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23510c14-feb5-41ec-8400-8f8fbd8df57e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.460575 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460527 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fec65f74-94ce-4780-ba9d-a4230023f010-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.460575 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/23510c14-feb5-41ec-8400-8f8fbd8df57e-snapshots\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.460794 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460592 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23510c14-feb5-41ec-8400-8f8fbd8df57e-serving-cert\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.460794 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460633 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.460794 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460659 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23510c14-feb5-41ec-8400-8f8fbd8df57e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.460794 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fec65f74-94ce-4780-ba9d-a4230023f010-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.460794 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.460714 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23510c14-feb5-41ec-8400-8f8fbd8df57e-tmp\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.460794 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.460594 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:36.460794 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.460618 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 18:54:36.461081 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.460809 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls podName:6b56f683-6467-45f5-b97a-68515cfe1abe nodeName:}" failed. No retries permitted until 2026-07-14 18:54:36.960790144 +0000 UTC m=+40.313613651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls") pod "cluster-samples-operator-65db858894-gkb72" (UID: "6b56f683-6467-45f5-b97a-68515cfe1abe") : secret "samples-operator-tls" not found Jul 14 18:54:36.461081 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.460826 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls podName:fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:36.960816838 +0000 UTC m=+40.313640341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xqxx8" (UID: "fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605") : secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:36.461252 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.461187 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/23510c14-feb5-41ec-8400-8f8fbd8df57e-snapshots\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.461583 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.461547 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.462281 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.461884 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23510c14-feb5-41ec-8400-8f8fbd8df57e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.462281 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.462200 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23510c14-feb5-41ec-8400-8f8fbd8df57e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.466757 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.465773 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23510c14-feb5-41ec-8400-8f8fbd8df57e-serving-cert\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.473228 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.473209 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8jnc\" (UniqueName: \"kubernetes.io/projected/23510c14-feb5-41ec-8400-8f8fbd8df57e-kube-api-access-k8jnc\") pod \"insights-operator-68d9dd94cf-skc5m\" (UID: \"23510c14-feb5-41ec-8400-8f8fbd8df57e\") " pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.473805 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.473769 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4k6d\" (UniqueName: \"kubernetes.io/projected/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-kube-api-access-k4k6d\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.473889 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.473822 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2lm7\" (UniqueName: \"kubernetes.io/projected/6b56f683-6467-45f5-b97a-68515cfe1abe-kube-api-access-m2lm7\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:36.487304 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.487272 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg"] Jul 14 18:54:36.492571 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.492552 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-899pv"] Jul 14 18:54:36.492680 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.492662 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg" Jul 14 18:54:36.495151 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.495130 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:54:36.495222 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.495179 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 18:54:36.495413 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.495400 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-w8xbb\"" Jul 14 18:54:36.495780 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.495767 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.499813 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.499770 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 18:54:36.500050 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.500008 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 18:54:36.500869 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.500848 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wll2h\"" Jul 14 18:54:36.500969 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.500941 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 18:54:36.502300 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.502283 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 18:54:36.503073 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.503055 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg"] Jul 14 18:54:36.507758 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.507735 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 18:54:36.510172 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.510151 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-899pv"] Jul 14 18:54:36.541717 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.541692 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:36.561879 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.561859 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdwr8\" (UniqueName: \"kubernetes.io/projected/209d0429-de45-4ec3-b777-1d6f53a9ee4d-kube-api-access-bdwr8\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.561982 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.561889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fec65f74-94ce-4780-ba9d-a4230023f010-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.561982 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.561917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.561982 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.561940 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ns4m\" (UniqueName: \"kubernetes.io/projected/986dcd81-a48c-451d-b9c1-9e1b4634171a-kube-api-access-6ns4m\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.562140 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.562062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s596m\" (UniqueName: \"kubernetes.io/projected/fec65f74-94ce-4780-ba9d-a4230023f010-kube-api-access-s596m\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.562140 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.562096 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.562263 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.562141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/986dcd81-a48c-451d-b9c1-9e1b4634171a-config\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.562263 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.562201 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/986dcd81-a48c-451d-b9c1-9e1b4634171a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.562376 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.562286 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-default-certificate\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.562376 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.562365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-stats-auth\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.562478 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.562465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fec65f74-94ce-4780-ba9d-a4230023f010-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.562524 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.562495 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fec65f74-94ce-4780-ba9d-a4230023f010-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.564509 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.564485 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fec65f74-94ce-4780-ba9d-a4230023f010-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.570179 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.570159 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s596m\" (UniqueName: \"kubernetes.io/projected/fec65f74-94ce-4780-ba9d-a4230023f010-kube-api-access-s596m\") pod \"kube-storage-version-migrator-operator-799cb7f958-7v722\" (UID: \"fec65f74-94ce-4780-ba9d-a4230023f010\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.597582 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.597565 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" Jul 14 18:54:36.642588 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.642488 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:36.663154 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663123 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/986dcd81-a48c-451d-b9c1-9e1b4634171a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.663387 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663307 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-default-certificate\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.663387 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-stats-auth\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.663516 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-trusted-ca\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.663516 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663463 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6rdc\" (UniqueName: \"kubernetes.io/projected/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-kube-api-access-z6rdc\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.663617 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663519 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdwr8\" (UniqueName: \"kubernetes.io/projected/209d0429-de45-4ec3-b777-1d6f53a9ee4d-kube-api-access-bdwr8\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.663617 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663545 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q9tl\" (UniqueName: \"kubernetes.io/projected/e96a5b4a-3b87-4724-bff6-d6cb6c8a087e-kube-api-access-6q9tl\") pod \"volume-data-source-validator-78495597f6-ks9fg\" (UID: \"e96a5b4a-3b87-4724-bff6-d6cb6c8a087e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg" Jul 14 18:54:36.663617 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663587 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.663771 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663614 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ns4m\" (UniqueName: \"kubernetes.io/projected/986dcd81-a48c-451d-b9c1-9e1b4634171a-kube-api-access-6ns4m\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.663771 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663638 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-serving-cert\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.663771 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663713 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.663771 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/986dcd81-a48c-451d-b9c1-9e1b4634171a-config\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.663951 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.663789 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-config\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.664000 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.663969 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:37.163949185 +0000 UTC m=+40.516772707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : configmap references non-existent config key: service-ca.crt Jul 14 18:54:36.664679 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.664276 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 18:54:36.664679 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.664349 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:37.164329963 +0000 UTC m=+40.517153477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : secret "router-metrics-certs-default" not found Jul 14 18:54:36.664838 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.664800 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/986dcd81-a48c-451d-b9c1-9e1b4634171a-config\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.666948 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.666919 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/986dcd81-a48c-451d-b9c1-9e1b4634171a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.667282 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.667262 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-default-certificate\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.668766 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.668742 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-stats-auth\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.674964 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.674945 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ns4m\" (UniqueName: \"kubernetes.io/projected/986dcd81-a48c-451d-b9c1-9e1b4634171a-kube-api-access-6ns4m\") pod \"service-ca-operator-7695fc6c8c-p685m\" (UID: \"986dcd81-a48c-451d-b9c1-9e1b4634171a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.676576 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.676558 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdwr8\" (UniqueName: \"kubernetes.io/projected/209d0429-de45-4ec3-b777-1d6f53a9ee4d-kube-api-access-bdwr8\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:36.686005 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.685529 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" Jul 14 18:54:36.694699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.694676 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" Jul 14 18:54:36.745571 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.745519 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-skc5m"] Jul 14 18:54:36.750473 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:36.750442 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23510c14_feb5_41ec_8400_8f8fbd8df57e.slice/crio-b6ca4faab536616d2569efc4456f08286be3beef4e64959bc628c6cb2cb1054e WatchSource:0}: Error finding container b6ca4faab536616d2569efc4456f08286be3beef4e64959bc628c6cb2cb1054e: Status 404 returned error can't find the container with id b6ca4faab536616d2569efc4456f08286be3beef4e64959bc628c6cb2cb1054e Jul 14 18:54:36.765170 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.765137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q9tl\" (UniqueName: \"kubernetes.io/projected/e96a5b4a-3b87-4724-bff6-d6cb6c8a087e-kube-api-access-6q9tl\") pod \"volume-data-source-validator-78495597f6-ks9fg\" (UID: \"e96a5b4a-3b87-4724-bff6-d6cb6c8a087e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg" Jul 14 18:54:36.765302 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.765204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-serving-cert\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.766718 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.766659 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-config\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.767047 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.766990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-trusted-ca\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.767343 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.767266 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6rdc\" (UniqueName: \"kubernetes.io/projected/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-kube-api-access-z6rdc\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.767696 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.767641 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-config\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.769265 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.769074 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-trusted-ca\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.770939 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.770871 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-serving-cert\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.776788 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.776734 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q9tl\" (UniqueName: \"kubernetes.io/projected/e96a5b4a-3b87-4724-bff6-d6cb6c8a087e-kube-api-access-6q9tl\") pod \"volume-data-source-validator-78495597f6-ks9fg\" (UID: \"e96a5b4a-3b87-4724-bff6-d6cb6c8a087e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg" Jul 14 18:54:36.777432 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.777403 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6rdc\" (UniqueName: \"kubernetes.io/projected/ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a-kube-api-access-z6rdc\") pod \"console-operator-7866497494-899pv\" (UID: \"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a\") " pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.823932 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.823736 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg" Jul 14 18:54:36.827535 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.827506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:36.855441 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.855410 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722"] Jul 14 18:54:36.860515 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:36.860205 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec65f74_94ce_4780_ba9d_a4230023f010.slice/crio-d62af99da1adefcdc9c538d73ef2bb70986e816b10a53c89c114d7b525d0460d WatchSource:0}: Error finding container d62af99da1adefcdc9c538d73ef2bb70986e816b10a53c89c114d7b525d0460d: Status 404 returned error can't find the container with id d62af99da1adefcdc9c538d73ef2bb70986e816b10a53c89c114d7b525d0460d Jul 14 18:54:36.893124 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.893048 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m"] Jul 14 18:54:36.895697 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:36.895667 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986dcd81_a48c_451d_b9c1_9e1b4634171a.slice/crio-88c191776f9223181d96e09a3f41d061c815e378317155f47d4719d03e377455 WatchSource:0}: Error finding container 88c191776f9223181d96e09a3f41d061c815e378317155f47d4719d03e377455: Status 404 returned error can't find the container with id 88c191776f9223181d96e09a3f41d061c815e378317155f47d4719d03e377455 Jul 14 18:54:36.970333 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.970220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:36.970501 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:36.970336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:36.970501 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.970471 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 18:54:36.970603 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.970539 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls podName:6b56f683-6467-45f5-b97a-68515cfe1abe nodeName:}" failed. No retries permitted until 2026-07-14 18:54:37.970518415 +0000 UTC m=+41.323341933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls") pod "cluster-samples-operator-65db858894-gkb72" (UID: "6b56f683-6467-45f5-b97a-68515cfe1abe") : secret "samples-operator-tls" not found Jul 14 18:54:36.970876 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.970765 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:36.970876 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:36.970828 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls podName:fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:37.970812383 +0000 UTC m=+41.323635888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xqxx8" (UID: "fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605") : secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:37.001959 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.001927 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg"] Jul 14 18:54:37.008016 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.007981 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-899pv"] Jul 14 18:54:37.153610 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.153551 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:37.171798 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.171768 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:37.171966 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.171835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:37.171966 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.171945 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 18:54:37.172054 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.171962 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:38.171940939 +0000 UTC m=+41.524764443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : configmap references non-existent config key: service-ca.crt Jul 14 18:54:37.172054 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.171997 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:38.171981524 +0000 UTC m=+41.524805024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : secret "router-metrics-certs-default" not found Jul 14 18:54:37.293583 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.293532 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:37.379013 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.378977 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:37.414423 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.414349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" event={"ID":"986dcd81-a48c-451d-b9c1-9e1b4634171a","Type":"ContainerStarted","Data":"88c191776f9223181d96e09a3f41d061c815e378317155f47d4719d03e377455"} Jul 14 18:54:37.415628 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.415603 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" event={"ID":"fec65f74-94ce-4780-ba9d-a4230023f010","Type":"ContainerStarted","Data":"d62af99da1adefcdc9c538d73ef2bb70986e816b10a53c89c114d7b525d0460d"} Jul 14 18:54:37.416836 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.416812 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" event={"ID":"23510c14-feb5-41ec-8400-8f8fbd8df57e","Type":"ContainerStarted","Data":"b6ca4faab536616d2569efc4456f08286be3beef4e64959bc628c6cb2cb1054e"} Jul 14 18:54:37.420495 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.420474 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" event={"ID":"0a1cbd2a-65eb-4c68-b14f-92cbb8fe5f65","Type":"ContainerStarted","Data":"defbb3b3047bc0defa82590b094b028916a559d7eb1e02a805155ee5a96942ad"} Jul 14 18:54:37.444863 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.444808 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kgxnw" podStartSLOduration=16.062454032 podStartE2EDuration="39.444789804s" totalImagesPullingTime="23.382335772s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:37.44395243 +0000 UTC m=+40.796775952" watchObservedRunningTime="2026-07-14 18:54:37.444789804 +0000 UTC m=+40.797613326" Jul 14 18:54:37.448724 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.448698 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:37.536295 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.536258 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:37.636131 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.636095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:37.707603 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:37.707535 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96a5b4a_3b87_4724_bff6_d6cb6c8a087e.slice/crio-d140dece5c3bbec997667e8930227fabc1f98632d5dfb662b3e7afffe6aacbc0 WatchSource:0}: Error finding container d140dece5c3bbec997667e8930227fabc1f98632d5dfb662b3e7afffe6aacbc0: Status 404 returned error can't find the container with id d140dece5c3bbec997667e8930227fabc1f98632d5dfb662b3e7afffe6aacbc0 Jul 14 18:54:37.708283 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:37.708256 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee55fd33_7c23_4f00_8a6e_2ad4eb600f7a.slice/crio-b8f46ab03791745fcd270782fe2a2f47dc53da486cfca951a07610ea2d25b79e WatchSource:0}: Error finding container b8f46ab03791745fcd270782fe2a2f47dc53da486cfca951a07610ea2d25b79e: Status 404 returned error can't find the container with id b8f46ab03791745fcd270782fe2a2f47dc53da486cfca951a07610ea2d25b79e Jul 14 18:54:37.716901 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.716874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:37.776621 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.776593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:37.776739 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.776635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:37.776739 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.776721 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 18:54:37.776739 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.776738 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f6c8468c-kpmzn: secret "image-registry-tls" not found Jul 14 18:54:37.776833 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.776776 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 18:54:37.776833 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.776784 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls podName:4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:41.77677065 +0000 UTC m=+45.129594150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls") pod "image-registry-78f6c8468c-kpmzn" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d") : secret "image-registry-tls" not found Jul 14 18:54:37.776833 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.776818 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls podName:99a6be85-dd78-4145-910f-50e264877d17 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:41.776807254 +0000 UTC m=+45.129630753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls") pod "dns-default-4wpdm" (UID: "99a6be85-dd78-4145-910f-50e264877d17") : secret "dns-default-metrics-tls" not found Jul 14 18:54:37.978532 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.978469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:37.978532 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:37.978524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:37.978684 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.978611 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:37.978684 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.978624 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 18:54:37.978684 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.978672 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls podName:6b56f683-6467-45f5-b97a-68515cfe1abe nodeName:}" failed. No retries permitted until 2026-07-14 18:54:39.978659567 +0000 UTC m=+43.331483066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls") pod "cluster-samples-operator-65db858894-gkb72" (UID: "6b56f683-6467-45f5-b97a-68515cfe1abe") : secret "samples-operator-tls" not found Jul 14 18:54:37.978684 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:37.978685 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls podName:fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:39.97867892 +0000 UTC m=+43.331502418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xqxx8" (UID: "fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605") : secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:38.179805 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.179444 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:38.179805 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.179531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:38.179805 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:38.179595 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:40.179571241 +0000 UTC m=+43.532394744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : configmap references non-existent config key: service-ca.crt Jul 14 18:54:38.179805 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:38.179667 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 18:54:38.179805 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:38.179724 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:40.179708935 +0000 UTC m=+43.532532449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : secret "router-metrics-certs-default" not found Jul 14 18:54:38.270067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.269934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:38.377447 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.377396 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:38.427039 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.426311 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mrx77" event={"ID":"750a0fb6-f2ad-41b9-a9a9-a2fca77081c4","Type":"ContainerStarted","Data":"e831f0ab41461be68f303809885bbc94e915f5e07ce0bd23860909b2ccb5338b"} Jul 14 18:54:38.430618 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.430587 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-899pv" event={"ID":"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a","Type":"ContainerStarted","Data":"b8f46ab03791745fcd270782fe2a2f47dc53da486cfca951a07610ea2d25b79e"} Jul 14 18:54:38.432831 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.432804 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg" event={"ID":"e96a5b4a-3b87-4724-bff6-d6cb6c8a087e","Type":"ContainerStarted","Data":"d140dece5c3bbec997667e8930227fabc1f98632d5dfb662b3e7afffe6aacbc0"} Jul 14 18:54:38.446748 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.445446 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mrx77" podStartSLOduration=0.903748435 podStartE2EDuration="4.445428539s" totalImagesPullingTime="3.541680104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:38.445260377 +0000 UTC m=+41.798083925" watchObservedRunningTime="2026-07-14 18:54:38.445428539 +0000 UTC m=+41.798252064" Jul 14 18:54:38.455567 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.455477 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:38.662425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.662344 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:38.749461 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:38.749348 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" limit=1024 Jul 14 18:54:39.997023 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:39.996976 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:39.997429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:39.997076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:39.997429 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:39.997155 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:39.997429 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:39.997188 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 18:54:39.997429 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:39.997228 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls podName:fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:43.997210554 +0000 UTC m=+47.350034053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xqxx8" (UID: "fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605") : secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:39.997429 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:39.997260 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls podName:6b56f683-6467-45f5-b97a-68515cfe1abe nodeName:}" failed. No retries permitted until 2026-07-14 18:54:43.997250603 +0000 UTC m=+47.350074103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls") pod "cluster-samples-operator-65db858894-gkb72" (UID: "6b56f683-6467-45f5-b97a-68515cfe1abe") : secret "samples-operator-tls" not found Jul 14 18:54:40.198507 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:40.198474 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:40.198648 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:40.198524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:40.198648 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:40.198610 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 18:54:40.198648 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:40.198633 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:44.198616785 +0000 UTC m=+47.551440284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : configmap references non-existent config key: service-ca.crt Jul 14 18:54:40.198775 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:40.198656 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:44.198649595 +0000 UTC m=+47.551473093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : secret "router-metrics-certs-default" not found Jul 14 18:54:41.809207 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:41.809165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:41.809633 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:41.809220 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:41.809633 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:41.809328 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 18:54:41.809633 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:41.809351 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f6c8468c-kpmzn: secret "image-registry-tls" not found Jul 14 18:54:41.809633 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:41.809336 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 18:54:41.809633 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:41.809398 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls podName:4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:49.809384322 +0000 UTC m=+53.162207821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls") pod "image-registry-78f6c8468c-kpmzn" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d") : secret "image-registry-tls" not found Jul 14 18:54:41.809633 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:41.809433 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls podName:99a6be85-dd78-4145-910f-50e264877d17 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:49.809417145 +0000 UTC m=+53.162240644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls") pod "dns-default-4wpdm" (UID: "99a6be85-dd78-4145-910f-50e264877d17") : secret "dns-default-metrics-tls" not found Jul 14 18:54:42.202540 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.202459 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl"] Jul 14 18:54:42.225095 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.225063 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl"] Jul 14 18:54:42.225227 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.225190 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl" Jul 14 18:54:42.228140 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.228114 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nhhcn\"" Jul 14 18:54:42.414616 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.414578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9hxw\" (UniqueName: \"kubernetes.io/projected/f49ef3cc-7740-4b92-a56e-5532be71e807-kube-api-access-j9hxw\") pod \"network-check-source-869dcfcdcd-j8zkl\" (UID: \"f49ef3cc-7740-4b92-a56e-5532be71e807\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl" Jul 14 18:54:42.516072 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.516002 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9hxw\" (UniqueName: \"kubernetes.io/projected/f49ef3cc-7740-4b92-a56e-5532be71e807-kube-api-access-j9hxw\") pod \"network-check-source-869dcfcdcd-j8zkl\" (UID: \"f49ef3cc-7740-4b92-a56e-5532be71e807\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl" Jul 14 18:54:42.526323 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.526287 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9hxw\" (UniqueName: \"kubernetes.io/projected/f49ef3cc-7740-4b92-a56e-5532be71e807-kube-api-access-j9hxw\") pod \"network-check-source-869dcfcdcd-j8zkl\" (UID: \"f49ef3cc-7740-4b92-a56e-5532be71e807\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl" Jul 14 18:54:42.535127 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.535106 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl" Jul 14 18:54:42.846743 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:42.846709 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49ef3cc_7740_4b92_a56e_5532be71e807.slice/crio-33e16c2247f3593d2b016f4d1617f795b09e4968a8ab00401c8f41276a8afe5e WatchSource:0}: Error finding container 33e16c2247f3593d2b016f4d1617f795b09e4968a8ab00401c8f41276a8afe5e: Status 404 returned error can't find the container with id 33e16c2247f3593d2b016f4d1617f795b09e4968a8ab00401c8f41276a8afe5e Jul 14 18:54:42.847434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:42.847410 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl"] Jul 14 18:54:43.450173 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.450128 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" event={"ID":"23510c14-feb5-41ec-8400-8f8fbd8df57e","Type":"ContainerStarted","Data":"d0c55253d18f9c09d869ddf4d7bf5ff9959be932e67d046b64aee4d8cbe6b08a"} Jul 14 18:54:43.452638 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.452616 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/0.log" Jul 14 18:54:43.452775 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.452652 2573 generic.go:356] "Generic (PLEG): container finished" podID="ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a" containerID="a3e89c5ecbec09dfd4502bb9300a018198c74c24a8f27abb46baa09416d45d97" exitCode=255 Jul 14 18:54:43.452775 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.452756 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-899pv" event={"ID":"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a","Type":"ContainerDied","Data":"a3e89c5ecbec09dfd4502bb9300a018198c74c24a8f27abb46baa09416d45d97"} Jul 14 18:54:43.453282 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.453009 2573 scope.go:117] "RemoveContainer" containerID="a3e89c5ecbec09dfd4502bb9300a018198c74c24a8f27abb46baa09416d45d97" Jul 14 18:54:43.455310 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.455255 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg" event={"ID":"e96a5b4a-3b87-4724-bff6-d6cb6c8a087e","Type":"ContainerStarted","Data":"a43ca897b224dd71f91677d73f31409c4b05072cbb660f52a8a9c2cb44dc51aa"} Jul 14 18:54:43.457444 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.457422 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" event={"ID":"986dcd81-a48c-451d-b9c1-9e1b4634171a","Type":"ContainerStarted","Data":"71534188ad5f3242dca678a61d8facb55e6749c66b9494a369b329a789f84fa2"} Jul 14 18:54:43.459605 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.459556 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" event={"ID":"fec65f74-94ce-4780-ba9d-a4230023f010","Type":"ContainerStarted","Data":"9938c5da09df0b82198483ccb6b4634295a58fbf11cc2a6406415b483a418107"} Jul 14 18:54:43.461440 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.461392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl" event={"ID":"f49ef3cc-7740-4b92-a56e-5532be71e807","Type":"ContainerStarted","Data":"33e16c2247f3593d2b016f4d1617f795b09e4968a8ab00401c8f41276a8afe5e"} Jul 14 18:54:43.485657 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.485270 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" podStartSLOduration=1.5255568099999999 podStartE2EDuration="7.485250559s" totalImagesPullingTime="5.959693749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:43.46839359 +0000 UTC m=+46.821217136" watchObservedRunningTime="2026-07-14 18:54:43.485250559 +0000 UTC m=+46.838074077" Jul 14 18:54:43.507492 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.507445 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-ks9fg" podStartSLOduration=2.505390323 podStartE2EDuration="7.507424993s" totalImagesPullingTime="5.00203467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:43.485503733 +0000 UTC m=+46.838327255" watchObservedRunningTime="2026-07-14 18:54:43.507424993 +0000 UTC m=+46.860248516" Jul 14 18:54:43.529689 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.529617 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" podStartSLOduration=1.7157649799999999 podStartE2EDuration="7.529598902s" totalImagesPullingTime="5.813833922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:43.52929661 +0000 UTC m=+46.882120125" watchObservedRunningTime="2026-07-14 18:54:43.529598902 +0000 UTC m=+46.882422419" Jul 14 18:54:43.556209 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:43.556153 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" podStartSLOduration=1.706408011 podStartE2EDuration="7.556136508s" totalImagesPullingTime="5.849728497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:43.555267851 +0000 UTC m=+46.908091378" watchObservedRunningTime="2026-07-14 18:54:43.556136508 +0000 UTC m=+46.908960029" Jul 14 18:54:44.029464 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.029416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:44.029908 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:44.029600 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:44.029908 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:44.029700 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls podName:fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:52.029678609 +0000 UTC m=+55.382502119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xqxx8" (UID: "fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605") : secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:44.029908 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:44.029719 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 18:54:44.029908 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.029624 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:44.029908 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:44.029776 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls podName:6b56f683-6467-45f5-b97a-68515cfe1abe nodeName:}" failed. No retries permitted until 2026-07-14 18:54:52.02975958 +0000 UTC m=+55.382583080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls") pod "cluster-samples-operator-65db858894-gkb72" (UID: "6b56f683-6467-45f5-b97a-68515cfe1abe") : secret "samples-operator-tls" not found Jul 14 18:54:44.178069 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.178036 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l"] Jul 14 18:54:44.201912 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.201882 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l"] Jul 14 18:54:44.202063 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.202013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" Jul 14 18:54:44.204928 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.204517 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 14 18:54:44.204928 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.204591 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xbvrn\"" Jul 14 18:54:44.204928 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.204748 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 14 18:54:44.231304 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.231274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:44.231430 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.231339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:44.231536 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:44.231520 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 18:54:44.231590 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:44.231581 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:52.231562193 +0000 UTC m=+55.584385707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : secret "router-metrics-certs-default" not found Jul 14 18:54:44.231720 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:44.231688 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:54:52.231669868 +0000 UTC m=+55.584493383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : configmap references non-existent config key: service-ca.crt Jul 14 18:54:44.332119 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.332069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4d8v\" (UniqueName: \"kubernetes.io/projected/ee3c4b33-b809-48d4-9ce8-d167649f4e77-kube-api-access-r4d8v\") pod \"migrator-7f59b54f6c-fzh7l\" (UID: \"ee3c4b33-b809-48d4-9ce8-d167649f4e77\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" Jul 14 18:54:44.433146 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.433114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4d8v\" (UniqueName: \"kubernetes.io/projected/ee3c4b33-b809-48d4-9ce8-d167649f4e77-kube-api-access-r4d8v\") pod \"migrator-7f59b54f6c-fzh7l\" (UID: \"ee3c4b33-b809-48d4-9ce8-d167649f4e77\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" Jul 14 18:54:44.447099 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.447068 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4d8v\" (UniqueName: \"kubernetes.io/projected/ee3c4b33-b809-48d4-9ce8-d167649f4e77-kube-api-access-r4d8v\") pod \"migrator-7f59b54f6c-fzh7l\" (UID: \"ee3c4b33-b809-48d4-9ce8-d167649f4e77\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" Jul 14 18:54:44.466702 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.466664 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 18:54:44.467185 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.467162 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/0.log" Jul 14 18:54:44.467316 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.467202 2573 generic.go:356] "Generic (PLEG): container finished" podID="ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a" containerID="0046fe9c77f06118800006b98a6adff24dc47dd35246f7c2c2d07559e7a15cca" exitCode=255 Jul 14 18:54:44.467316 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.467271 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-899pv" event={"ID":"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a","Type":"ContainerDied","Data":"0046fe9c77f06118800006b98a6adff24dc47dd35246f7c2c2d07559e7a15cca"} Jul 14 18:54:44.467426 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.467346 2573 scope.go:117] "RemoveContainer" containerID="a3e89c5ecbec09dfd4502bb9300a018198c74c24a8f27abb46baa09416d45d97" Jul 14 18:54:44.467557 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.467539 2573 scope.go:117] "RemoveContainer" containerID="0046fe9c77f06118800006b98a6adff24dc47dd35246f7c2c2d07559e7a15cca" Jul 14 18:54:44.468023 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:44.467727 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-899pv_openshift-console-operator(ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a)\"" pod="openshift-console-operator/console-operator-7866497494-899pv" podUID="ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a" Jul 14 18:54:44.513400 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.513373 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" Jul 14 18:54:44.688638 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.688565 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l"] Jul 14 18:54:44.691376 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:44.691340 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3c4b33_b809_48d4_9ce8_d167649f4e77.slice/crio-65faefb00e57072137e66bf82521e17fd3eadf4cc49e7170ee083b38c056e0fd WatchSource:0}: Error finding container 65faefb00e57072137e66bf82521e17fd3eadf4cc49e7170ee083b38c056e0fd: Status 404 returned error can't find the container with id 65faefb00e57072137e66bf82521e17fd3eadf4cc49e7170ee083b38c056e0fd Jul 14 18:54:44.937719 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.937639 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zk9z6"] Jul 14 18:54:44.965869 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.965829 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zk9z6"] Jul 14 18:54:44.966150 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.966019 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:44.968553 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.968530 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 18:54:44.968553 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.968547 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p26hg\"" Jul 14 18:54:44.968674 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:44.968547 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 18:54:45.038817 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.038782 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae95650b-5ed5-4a6b-bc9d-51290c403544-crio-socket\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.039213 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.038911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqn9s\" (UniqueName: \"kubernetes.io/projected/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-api-access-fqn9s\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.039213 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.039007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.039213 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.039051 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae95650b-5ed5-4a6b-bc9d-51290c403544-data-volume\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.039213 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.039078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.139492 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.139447 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae95650b-5ed5-4a6b-bc9d-51290c403544-crio-socket\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.139654 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.139566 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqn9s\" (UniqueName: \"kubernetes.io/projected/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-api-access-fqn9s\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.139654 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.139593 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ae95650b-5ed5-4a6b-bc9d-51290c403544-crio-socket\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.139654 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.139620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.139814 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.139667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae95650b-5ed5-4a6b-bc9d-51290c403544-data-volume\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.139814 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.139687 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 18:54:45.139814 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.139700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.139814 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.139750 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:45.639729157 +0000 UTC m=+48.992552674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : configmap "kube-rbac-proxy" not found Jul 14 18:54:45.140000 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.139822 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 18:54:45.140000 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.139868 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:45.639854421 +0000 UTC m=+48.992677920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : secret "insights-runtime-extractor-tls" not found Jul 14 18:54:45.140091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.140071 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae95650b-5ed5-4a6b-bc9d-51290c403544-data-volume\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.148922 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.148894 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqn9s\" (UniqueName: \"kubernetes.io/projected/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-api-access-fqn9s\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.473253 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.473193 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" event={"ID":"ee3c4b33-b809-48d4-9ce8-d167649f4e77","Type":"ContainerStarted","Data":"65faefb00e57072137e66bf82521e17fd3eadf4cc49e7170ee083b38c056e0fd"} Jul 14 18:54:45.475777 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.475751 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 18:54:45.476147 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.476129 2573 scope.go:117] "RemoveContainer" containerID="0046fe9c77f06118800006b98a6adff24dc47dd35246f7c2c2d07559e7a15cca" Jul 14 18:54:45.476339 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.476318 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-899pv_openshift-console-operator(ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a)\"" pod="openshift-console-operator/console-operator-7866497494-899pv" podUID="ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a" Jul 14 18:54:45.644189 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.644152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.644394 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:45.644198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:45.644394 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.644308 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 18:54:45.644515 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.644396 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:46.64437428 +0000 UTC m=+49.997197782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : configmap "kube-rbac-proxy" not found Jul 14 18:54:45.644515 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.644410 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 18:54:45.644515 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:45.644492 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:46.64447407 +0000 UTC m=+49.997297575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : secret "insights-runtime-extractor-tls" not found Jul 14 18:54:46.655468 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:46.655430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:46.655881 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:46.655481 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:46.655881 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:46.655566 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 18:54:46.655881 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:46.655600 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 18:54:46.655881 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:46.655654 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:48.655629699 +0000 UTC m=+52.008453198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : configmap "kube-rbac-proxy" not found Jul 14 18:54:46.655881 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:46.655675 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:48.655665377 +0000 UTC m=+52.008488880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : secret "insights-runtime-extractor-tls" not found Jul 14 18:54:46.828186 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:46.828153 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:46.828352 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:46.828216 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:46.828570 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:46.828558 2573 scope.go:117] "RemoveContainer" containerID="0046fe9c77f06118800006b98a6adff24dc47dd35246f7c2c2d07559e7a15cca" Jul 14 18:54:46.828718 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:46.828701 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-899pv_openshift-console-operator(ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a)\"" pod="openshift-console-operator/console-operator-7866497494-899pv" podUID="ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a" Jul 14 18:54:46.940446 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:46.940418 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jbdkb_3d421be0-d91a-41c1-b8e0-ec2205fe6be4/dns-node-resolver/0.log" Jul 14 18:54:47.445411 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.445380 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-bgvzs"] Jul 14 18:54:47.459201 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.459175 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-bgvzs"] Jul 14 18:54:47.459363 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.459290 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.462638 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.462615 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 14 18:54:47.462840 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.462819 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pd2p7\"" Jul 14 18:54:47.462957 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.462842 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 14 18:54:47.462957 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.462913 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 14 18:54:47.463348 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.463331 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 14 18:54:47.482408 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.482373 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl" event={"ID":"f49ef3cc-7740-4b92-a56e-5532be71e807","Type":"ContainerStarted","Data":"fce1dffd0af7dbba6c1e3370552df2aba598b6623b7d0890b4d7205eecfb198d"} Jul 14 18:54:47.497211 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.497042 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-j8zkl" podStartSLOduration=1.8866488289999999 podStartE2EDuration="5.497029016s" totalImagesPullingTime="3.610380187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:47.497018356 +0000 UTC m=+50.849841877" watchObservedRunningTime="2026-07-14 18:54:47.497029016 +0000 UTC m=+50.849852538" Jul 14 18:54:47.563143 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.563115 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rjb7\" (UniqueName: \"kubernetes.io/projected/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-kube-api-access-7rjb7\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.563284 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.563177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-signing-cabundle\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.563284 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.563209 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-signing-key\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.663749 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.663724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rjb7\" (UniqueName: \"kubernetes.io/projected/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-kube-api-access-7rjb7\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.664444 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.663765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-signing-cabundle\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.664444 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.663785 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-signing-key\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.664649 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.664490 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-signing-cabundle\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.666205 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.666182 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-signing-key\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.673916 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.673897 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rjb7\" (UniqueName: \"kubernetes.io/projected/2d5fcbdd-6d04-404b-b906-a0c594f2ead0-kube-api-access-7rjb7\") pod \"service-ca-79f68b9f4f-bgvzs\" (UID: \"2d5fcbdd-6d04-404b-b906-a0c594f2ead0\") " pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.740553 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.740536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qtf7j_fe5424b3-5c95-41a1-a9f0-ec481c863c63/node-ca/0.log" Jul 14 18:54:47.768662 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.768639 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" Jul 14 18:54:47.908510 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:47.908479 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-bgvzs"] Jul 14 18:54:47.912137 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:54:47.912108 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5fcbdd_6d04_404b_b906_a0c594f2ead0.slice/crio-3828dfa9356c2cc3acf8add25ffdbef76ce71b2fc92baea1cde19581d3359b87 WatchSource:0}: Error finding container 3828dfa9356c2cc3acf8add25ffdbef76ce71b2fc92baea1cde19581d3359b87: Status 404 returned error can't find the container with id 3828dfa9356c2cc3acf8add25ffdbef76ce71b2fc92baea1cde19581d3359b87 Jul 14 18:54:48.340697 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.340662 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mrx77_750a0fb6-f2ad-41b9-a9a9-a2fca77081c4/serve-healthcheck-canary/0.log" Jul 14 18:54:48.489137 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.489102 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" event={"ID":"ee3c4b33-b809-48d4-9ce8-d167649f4e77","Type":"ContainerStarted","Data":"39a54ae0fac7a94845f6acec477df6bf00678931871d859d8dcd15841838e4cd"} Jul 14 18:54:48.489326 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.489165 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" event={"ID":"ee3c4b33-b809-48d4-9ce8-d167649f4e77","Type":"ContainerStarted","Data":"7c22605b86fc58e72d74c0c176cb430653ca75ca1bc219eab59d7314aded9c0c"} Jul 14 18:54:48.490784 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.490752 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" event={"ID":"2d5fcbdd-6d04-404b-b906-a0c594f2ead0","Type":"ContainerStarted","Data":"26787f59fba64dff69c9aa35fb1e47760f865fce7c35d3afe71f59ec58f43b02"} Jul 14 18:54:48.490897 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.490807 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" event={"ID":"2d5fcbdd-6d04-404b-b906-a0c594f2ead0","Type":"ContainerStarted","Data":"3828dfa9356c2cc3acf8add25ffdbef76ce71b2fc92baea1cde19581d3359b87"} Jul 14 18:54:48.509072 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.509025 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-fzh7l" podStartSLOduration=1.537344745 podStartE2EDuration="4.509012743s" totalImagesPullingTime="2.971667998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:48.507841942 +0000 UTC m=+51.860665462" watchObservedRunningTime="2026-07-14 18:54:48.509012743 +0000 UTC m=+51.861836264" Jul 14 18:54:48.538100 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.538056 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-bgvzs" podStartSLOduration=1.53804317 podStartE2EDuration="1.53804317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:48.536965463 +0000 UTC m=+51.889788987" watchObservedRunningTime="2026-07-14 18:54:48.53804317 +0000 UTC m=+51.890866691" Jul 14 18:54:48.542620 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.542597 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fzh7l_ee3c4b33-b809-48d4-9ce8-d167649f4e77/migrator/0.log" Jul 14 18:54:48.672733 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.672649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:48.672733 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.672704 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:48.673131 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:48.672783 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 18:54:48.673131 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:48.672827 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 18:54:48.673131 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:48.672863 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:52.67284399 +0000 UTC m=+56.025667497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : configmap "kube-rbac-proxy" not found Jul 14 18:54:48.673131 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:48.672887 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:54:52.672871665 +0000 UTC m=+56.025695167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : secret "insights-runtime-extractor-tls" not found Jul 14 18:54:48.741355 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.741311 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-fzh7l_ee3c4b33-b809-48d4-9ce8-d167649f4e77/graceful-termination/0.log" Jul 14 18:54:48.950846 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:48.950751 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-7v722_fec65f74-94ce-4780-ba9d-a4230023f010/kube-storage-version-migrator-operator/0.log" Jul 14 18:54:49.883430 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:49.883400 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:54:49.883824 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:49.883528 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:54:49.883824 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:49.883568 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 18:54:49.883824 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:49.883613 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 18:54:49.883824 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:49.883624 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f6c8468c-kpmzn: secret "image-registry-tls" not found Jul 14 18:54:49.883824 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:49.883642 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls podName:99a6be85-dd78-4145-910f-50e264877d17 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:05.883620294 +0000 UTC m=+69.236443799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls") pod "dns-default-4wpdm" (UID: "99a6be85-dd78-4145-910f-50e264877d17") : secret "dns-default-metrics-tls" not found Jul 14 18:54:49.883824 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:49.883660 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls podName:4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d nodeName:}" failed. No retries permitted until 2026-07-14 18:55:05.883649873 +0000 UTC m=+69.236473372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls") pod "image-registry-78f6c8468c-kpmzn" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d") : secret "image-registry-tls" not found Jul 14 18:54:52.103136 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.103098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:52.103564 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.103213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:54:52.103564 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:52.103328 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:52.103564 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:52.103380 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls podName:fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:08.103367104 +0000 UTC m=+71.456190602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-xqxx8" (UID: "fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605") : secret "cluster-monitoring-operator-tls" not found Jul 14 18:54:52.105448 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.105428 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b56f683-6467-45f5-b97a-68515cfe1abe-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gkb72\" (UID: \"6b56f683-6467-45f5-b97a-68515cfe1abe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:52.191198 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.191169 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" Jul 14 18:54:52.305164 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.305137 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:52.305311 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.305198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:54:52.305364 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:52.305330 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 18:54:52.305402 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:52.305341 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:55:08.305321173 +0000 UTC m=+71.658144683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : configmap references non-existent config key: service-ca.crt Jul 14 18:54:52.305402 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:52.305383 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs podName:209d0429-de45-4ec3-b777-1d6f53a9ee4d nodeName:}" failed. No retries permitted until 2026-07-14 18:55:08.305373136 +0000 UTC m=+71.658196639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs") pod "router-default-b9c76f644-m2sfm" (UID: "209d0429-de45-4ec3-b777-1d6f53a9ee4d") : secret "router-metrics-certs-default" not found Jul 14 18:54:52.333724 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.333698 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72"] Jul 14 18:54:52.505006 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.504975 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" event={"ID":"6b56f683-6467-45f5-b97a-68515cfe1abe","Type":"ContainerStarted","Data":"be86c0dc1dc7e1a6957fa7275b62e1e1098ea3ab9f458e992cf526c3b51dc9f2"} Jul 14 18:54:52.708771 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.708696 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:52.708771 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.708736 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:52.708942 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:52.708840 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 18:54:52.708942 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:54:52.708893 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls podName:ae95650b-5ed5-4a6b-bc9d-51290c403544 nodeName:}" failed. No retries permitted until 2026-07-14 18:55:00.708880817 +0000 UTC m=+64.061704317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zk9z6" (UID: "ae95650b-5ed5-4a6b-bc9d-51290c403544") : secret "insights-runtime-extractor-tls" not found Jul 14 18:54:52.709208 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:52.709188 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ae95650b-5ed5-4a6b-bc9d-51290c403544-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:54:54.515301 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:54.515261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" event={"ID":"6b56f683-6467-45f5-b97a-68515cfe1abe","Type":"ContainerStarted","Data":"3ba806c1ab30d828bf0859e06f018475b28e18b5ac8dfeef77dc410564b7934d"} Jul 14 18:54:54.515745 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:54.515329 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" event={"ID":"6b56f683-6467-45f5-b97a-68515cfe1abe","Type":"ContainerStarted","Data":"ae5cdddbc0e3ecea411cd75a5254f165047631692d7a6da08547004fd66bcae6"} Jul 14 18:54:54.534354 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:54.534311 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gkb72" podStartSLOduration=16.546656991 podStartE2EDuration="18.534296873s" totalImagesPullingTime="1.987639882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:54.533443851 +0000 UTC m=+57.886267373" watchObservedRunningTime="2026-07-14 18:54:54.534296873 +0000 UTC m=+57.887120429" Jul 14 18:54:58.170112 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:58.170081 2573 scope.go:117] "RemoveContainer" containerID="0046fe9c77f06118800006b98a6adff24dc47dd35246f7c2c2d07559e7a15cca" Jul 14 18:54:58.530124 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:58.530054 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 18:54:58.530291 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:58.530126 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-899pv" event={"ID":"ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a","Type":"ContainerStarted","Data":"48137d782eb652f85981722669f9821a713db2382bd6e6d956d597d9c3ce431e"} Jul 14 18:54:58.530406 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:58.530381 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:58.552701 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:58.552652 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-899pv" podStartSLOduration=17.546868365 podStartE2EDuration="22.552635948s" totalImagesPullingTime="5.005767583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:54:58.552306249 +0000 UTC m=+61.905129770" watchObservedRunningTime="2026-07-14 18:54:58.552635948 +0000 UTC m=+61.905459469" Jul 14 18:54:59.292925 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:59.292891 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-899pv" Jul 14 18:54:59.400809 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:54:59.400784 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-56nsw" Jul 14 18:55:00.778499 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:00.778462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:55:00.780790 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:00.780759 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ae95650b-5ed5-4a6b-bc9d-51290c403544-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk9z6\" (UID: \"ae95650b-5ed5-4a6b-bc9d-51290c403544\") " pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:55:00.878061 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:00.878033 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p26hg\"" Jul 14 18:55:00.886694 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:00.886675 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zk9z6" Jul 14 18:55:01.009726 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:01.009701 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zk9z6"] Jul 14 18:55:01.012525 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:01.012500 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae95650b_5ed5_4a6b_bc9d_51290c403544.slice/crio-7ac1e768f265ba69b68e63e0912bc4439a521282a6221e8486ad15072109fbf2 WatchSource:0}: Error finding container 7ac1e768f265ba69b68e63e0912bc4439a521282a6221e8486ad15072109fbf2: Status 404 returned error can't find the container with id 7ac1e768f265ba69b68e63e0912bc4439a521282a6221e8486ad15072109fbf2 Jul 14 18:55:01.540807 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:01.540771 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk9z6" event={"ID":"ae95650b-5ed5-4a6b-bc9d-51290c403544","Type":"ContainerStarted","Data":"7ac1e768f265ba69b68e63e0912bc4439a521282a6221e8486ad15072109fbf2"} Jul 14 18:55:03.000435 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.000388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:55:03.000435 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.000431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:55:03.000935 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.000531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:55:03.002959 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.002920 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 18:55:03.003097 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.002973 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 18:55:03.003367 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.003345 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmbh\" (UniqueName: \"kubernetes.io/projected/4be3ee8d-c2cd-4795-a6cd-1a7303bfb648-kube-api-access-czmbh\") pod \"network-check-target-zg68b\" (UID: \"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648\") " pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:55:03.013311 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.013289 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f-original-pull-secret\") pod \"global-pull-secret-syncer-5nq78\" (UID: \"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f\") " pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:55:03.013311 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.013294 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f06de43-8eb1-4dc4-93cd-81347784e533-metrics-certs\") pod \"network-metrics-daemon-29qh5\" (UID: \"3f06de43-8eb1-4dc4-93cd-81347784e533\") " pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:55:03.082355 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.082325 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ltzph\"" Jul 14 18:55:03.084445 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.084414 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5nq78" Jul 14 18:55:03.090033 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.090002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-29qh5" Jul 14 18:55:03.282879 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.282811 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zn8zd\"" Jul 14 18:55:03.291051 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:03.291019 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:55:05.024304 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.024191 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5nq78"] Jul 14 18:55:05.028290 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:05.028222 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38cbc3f4_e252_4f0c_a155_5b9bcc9ca86f.slice/crio-f3ca297449e0938a389c0e06ad5e495b02c56913c31764959e18b6b9e3a12d1f WatchSource:0}: Error finding container f3ca297449e0938a389c0e06ad5e495b02c56913c31764959e18b6b9e3a12d1f: Status 404 returned error can't find the container with id f3ca297449e0938a389c0e06ad5e495b02c56913c31764959e18b6b9e3a12d1f Jul 14 18:55:05.044256 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.044151 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zg68b"] Jul 14 18:55:05.046415 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:05.046390 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be3ee8d_c2cd_4795_a6cd_1a7303bfb648.slice/crio-1f80a383bf2a0794c2954400af0cc86e2a2fb2978e301ff5f3781425fe3d70fc WatchSource:0}: Error finding container 1f80a383bf2a0794c2954400af0cc86e2a2fb2978e301ff5f3781425fe3d70fc: Status 404 returned error can't find the container with id 1f80a383bf2a0794c2954400af0cc86e2a2fb2978e301ff5f3781425fe3d70fc Jul 14 18:55:05.243404 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.243332 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-29qh5"] Jul 14 18:55:05.246657 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:05.246632 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f06de43_8eb1_4dc4_93cd_81347784e533.slice/crio-0c56d0594a9ee01b32ad03e83cb303b7da4ccd7d4c5c043f50458e950817e46f WatchSource:0}: Error finding container 0c56d0594a9ee01b32ad03e83cb303b7da4ccd7d4c5c043f50458e950817e46f: Status 404 returned error can't find the container with id 0c56d0594a9ee01b32ad03e83cb303b7da4ccd7d4c5c043f50458e950817e46f Jul 14 18:55:05.560192 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.560152 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zg68b" event={"ID":"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648","Type":"ContainerStarted","Data":"daa2f02a895789958487f04f015f676203fadc7cc1c508a8707c81359268e676"} Jul 14 18:55:05.560379 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.560224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zg68b" event={"ID":"4be3ee8d-c2cd-4795-a6cd-1a7303bfb648","Type":"ContainerStarted","Data":"1f80a383bf2a0794c2954400af0cc86e2a2fb2978e301ff5f3781425fe3d70fc"} Jul 14 18:55:05.560379 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.560273 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:55:05.561413 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.561388 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5nq78" event={"ID":"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f","Type":"ContainerStarted","Data":"f3ca297449e0938a389c0e06ad5e495b02c56913c31764959e18b6b9e3a12d1f"} Jul 14 18:55:05.562815 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.562793 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk9z6" event={"ID":"ae95650b-5ed5-4a6b-bc9d-51290c403544","Type":"ContainerStarted","Data":"0d6f4294e582425a8882977b4c94fecd62300b5847ec1e72f5e070353daca5a8"} Jul 14 18:55:05.564023 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.564003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29qh5" event={"ID":"3f06de43-8eb1-4dc4-93cd-81347784e533","Type":"ContainerStarted","Data":"0c56d0594a9ee01b32ad03e83cb303b7da4ccd7d4c5c043f50458e950817e46f"} Jul 14 18:55:05.925823 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.925784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:55:05.925957 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.925834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:55:05.928659 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.928609 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99a6be85-dd78-4145-910f-50e264877d17-metrics-tls\") pod \"dns-default-4wpdm\" (UID: \"99a6be85-dd78-4145-910f-50e264877d17\") " pod="openshift-dns/dns-default-4wpdm" Jul 14 18:55:05.928909 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:05.928887 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"image-registry-78f6c8468c-kpmzn\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:55:06.124890 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.124818 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s87bq\"" Jul 14 18:55:06.133048 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.133030 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:55:06.138994 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.138971 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p5svp\"" Jul 14 18:55:06.146511 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.146482 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4wpdm" Jul 14 18:55:06.557020 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.556968 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zg68b" podStartSLOduration=68.556948719 podStartE2EDuration="1m8.556948719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:05.577656814 +0000 UTC m=+68.930480356" watchObservedRunningTime="2026-07-14 18:55:06.556948719 +0000 UTC m=+69.909772252" Jul 14 18:55:06.557202 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.557189 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4wpdm"] Jul 14 18:55:06.559989 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:06.559962 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a6be85_dd78_4145_910f_50e264877d17.slice/crio-0928a4328d3a1a940ed9b20082888bbf38a013c64cbc7d6322a8c70cb350baa7 WatchSource:0}: Error finding container 0928a4328d3a1a940ed9b20082888bbf38a013c64cbc7d6322a8c70cb350baa7: Status 404 returned error can't find the container with id 0928a4328d3a1a940ed9b20082888bbf38a013c64cbc7d6322a8c70cb350baa7 Jul 14 18:55:06.568981 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.568956 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk9z6" event={"ID":"ae95650b-5ed5-4a6b-bc9d-51290c403544","Type":"ContainerStarted","Data":"e3e5e2a05dade40f10952b679181744b7082dddfa31fec8cf342c0a5347ea6cf"} Jul 14 18:55:06.569975 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.569956 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wpdm" event={"ID":"99a6be85-dd78-4145-910f-50e264877d17","Type":"ContainerStarted","Data":"0928a4328d3a1a940ed9b20082888bbf38a013c64cbc7d6322a8c70cb350baa7"} Jul 14 18:55:06.576668 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:06.576649 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f6c8468c-kpmzn"] Jul 14 18:55:06.579056 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:06.579023 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce34ae1_73e4_4d7e_b0d5_c4bdae35613d.slice/crio-5d87d9ea673589cdc53dc6d5760947f20e287352ff23099df790ce34efe3bf5c WatchSource:0}: Error finding container 5d87d9ea673589cdc53dc6d5760947f20e287352ff23099df790ce34efe3bf5c: Status 404 returned error can't find the container with id 5d87d9ea673589cdc53dc6d5760947f20e287352ff23099df790ce34efe3bf5c Jul 14 18:55:07.577319 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:07.576480 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29qh5" event={"ID":"3f06de43-8eb1-4dc4-93cd-81347784e533","Type":"ContainerStarted","Data":"381821c00e522bf298a9fee86fbcf07f918e50382404d01216ac01a531c98d51"} Jul 14 18:55:07.577319 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:07.576549 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-29qh5" event={"ID":"3f06de43-8eb1-4dc4-93cd-81347784e533","Type":"ContainerStarted","Data":"e1059926ac49cf837e3078b4264d3ca5bd508b55dcfd39003a02e8c308457117"} Jul 14 18:55:07.579732 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:07.579697 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" event={"ID":"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d","Type":"ContainerStarted","Data":"6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88"} Jul 14 18:55:07.579844 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:07.579748 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" event={"ID":"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d","Type":"ContainerStarted","Data":"5d87d9ea673589cdc53dc6d5760947f20e287352ff23099df790ce34efe3bf5c"} Jul 14 18:55:07.579978 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:07.579958 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:55:07.598256 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:07.596970 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-29qh5" podStartSLOduration=68.035667727 podStartE2EDuration="1m9.596952718s" totalImagesPullingTime="1.561284991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:07.596908389 +0000 UTC m=+70.949731912" watchObservedRunningTime="2026-07-14 18:55:07.596952718 +0000 UTC m=+70.949776243" Jul 14 18:55:07.620685 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:07.620643 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" podStartSLOduration=69.620627134 podStartE2EDuration="1m9.620627134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:07.618675232 +0000 UTC m=+70.971498765" watchObservedRunningTime="2026-07-14 18:55:07.620627134 +0000 UTC m=+70.973450654" Jul 14 18:55:08.147327 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.147286 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:55:08.150552 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.150521 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-xqxx8\" (UID: \"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:55:08.349032 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.348991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:08.349219 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.349110 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:08.349829 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.349800 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209d0429-de45-4ec3-b777-1d6f53a9ee4d-service-ca-bundle\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:08.351960 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.351916 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/209d0429-de45-4ec3-b777-1d6f53a9ee4d-metrics-certs\") pod \"router-default-b9c76f644-m2sfm\" (UID: \"209d0429-de45-4ec3-b777-1d6f53a9ee4d\") " pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:08.386089 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.386063 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6f2jc\"" Jul 14 18:55:08.394320 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.394227 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" Jul 14 18:55:08.502021 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.501990 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mc87v\"" Jul 14 18:55:08.510043 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:08.509973 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:11.268927 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.268689 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b9c76f644-m2sfm"] Jul 14 18:55:11.273513 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:11.273381 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209d0429_de45_4ec3_b777_1d6f53a9ee4d.slice/crio-439a7a93555d0d5be9d3e207054b3df0278037a00cbc7a3439532df06c74acc1 WatchSource:0}: Error finding container 439a7a93555d0d5be9d3e207054b3df0278037a00cbc7a3439532df06c74acc1: Status 404 returned error can't find the container with id 439a7a93555d0d5be9d3e207054b3df0278037a00cbc7a3439532df06c74acc1 Jul 14 18:55:11.286392 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.286324 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8"] Jul 14 18:55:11.293775 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:11.293740 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa09d2f0_fb0d_4c1d_a6fd_ce5c66d96605.slice/crio-6a77b49742034652f55a1739e8dc2375aee339c5bb86ab2093faa1f32b83cc5a WatchSource:0}: Error finding container 6a77b49742034652f55a1739e8dc2375aee339c5bb86ab2093faa1f32b83cc5a: Status 404 returned error can't find the container with id 6a77b49742034652f55a1739e8dc2375aee339c5bb86ab2093faa1f32b83cc5a Jul 14 18:55:11.600320 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.600210 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk9z6" event={"ID":"ae95650b-5ed5-4a6b-bc9d-51290c403544","Type":"ContainerStarted","Data":"a5b2b37a9ec3419a321a969f740f8c0a9f4cf142e0d074053ce67370a4e0cd31"} Jul 14 18:55:11.601666 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.601629 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5nq78" event={"ID":"38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f","Type":"ContainerStarted","Data":"b64adb9ec955a77ad9d497c1889174ddf62152e22819b2b69f94179466ec159d"} Jul 14 18:55:11.603309 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.603286 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wpdm" event={"ID":"99a6be85-dd78-4145-910f-50e264877d17","Type":"ContainerStarted","Data":"dd88421ecc481c7ff7006a0166aa5008e4f63dbbfe99ea161279aedc19b0ad91"} Jul 14 18:55:11.603420 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.603326 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4wpdm" event={"ID":"99a6be85-dd78-4145-910f-50e264877d17","Type":"ContainerStarted","Data":"223668551b517b48644cdb3a8fecf819a0bfaee9079e3a806f48f377148082ca"} Jul 14 18:55:11.603420 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.603385 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4wpdm" Jul 14 18:55:11.604413 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.604392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" event={"ID":"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605","Type":"ContainerStarted","Data":"6a77b49742034652f55a1739e8dc2375aee339c5bb86ab2093faa1f32b83cc5a"} Jul 14 18:55:11.605688 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.605666 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b9c76f644-m2sfm" event={"ID":"209d0429-de45-4ec3-b777-1d6f53a9ee4d","Type":"ContainerStarted","Data":"f5e802bfb8ea1d8fb6d6db3c7de9bcb04b13f7cfb4833769c16b0d4054820547"} Jul 14 18:55:11.605774 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.605699 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b9c76f644-m2sfm" event={"ID":"209d0429-de45-4ec3-b777-1d6f53a9ee4d","Type":"ContainerStarted","Data":"439a7a93555d0d5be9d3e207054b3df0278037a00cbc7a3439532df06c74acc1"} Jul 14 18:55:11.626324 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.626282 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zk9z6" podStartSLOduration=17.69182284 podStartE2EDuration="27.626270272s" totalImagesPullingTime="9.934447432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:54:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:11.624842284 +0000 UTC m=+74.977665814" watchObservedRunningTime="2026-07-14 18:55:11.626270272 +0000 UTC m=+74.979093817" Jul 14 18:55:11.649284 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.649213 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b9c76f644-m2sfm" podStartSLOduration=35.649200677 podStartE2EDuration="35.649200677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:11.648689392 +0000 UTC m=+75.001512914" watchObservedRunningTime="2026-07-14 18:55:11.649200677 +0000 UTC m=+75.002024196" Jul 14 18:55:11.688688 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.688642 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5nq78" podStartSLOduration=67.595196227 podStartE2EDuration="1m13.688627208s" totalImagesPullingTime="6.093430981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 18:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:11.666301348 +0000 UTC m=+75.019124898" watchObservedRunningTime="2026-07-14 18:55:11.688627208 +0000 UTC m=+75.041450731" Jul 14 18:55:11.689404 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:11.689374 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4wpdm" podStartSLOduration=33.145232288 podStartE2EDuration="37.689363018s" totalImagesPullingTime="4.54413073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:11.688798837 +0000 UTC m=+75.041622359" watchObservedRunningTime="2026-07-14 18:55:11.689363018 +0000 UTC m=+75.042186538" Jul 14 18:55:12.376917 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.376876 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2"] Jul 14 18:55:12.379401 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.379378 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" Jul 14 18:55:12.381759 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.381738 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 14 18:55:12.381883 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.381787 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 14 18:55:12.382644 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.382625 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 14 18:55:12.382772 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.382662 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 14 18:55:12.385434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.385414 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-n88gd\"" Jul 14 18:55:12.410544 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.410520 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2"] Jul 14 18:55:12.411603 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.411583 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn"] Jul 14 18:55:12.413478 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.413462 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.415703 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.415683 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 14 18:55:12.426592 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.426563 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq"] Jul 14 18:55:12.429334 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.429212 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.432860 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.432773 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 14 18:55:12.432860 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.432791 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn"] Jul 14 18:55:12.440163 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.440142 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 14 18:55:12.440704 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.440682 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 14 18:55:12.441514 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.441496 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 14 18:55:12.460261 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.460220 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq"] Jul 14 18:55:12.483572 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.483539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhnwl\" (UniqueName: \"kubernetes.io/projected/52bf56c1-aee8-413d-9037-b1bbf6801e8d-kube-api-access-bhnwl\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.483734 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.483710 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52bf56c1-aee8-413d-9037-b1bbf6801e8d-tmp\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.483807 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.483751 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/52bf56c1-aee8-413d-9037-b1bbf6801e8d-klusterlet-config\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.483807 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.483795 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw46q\" (UniqueName: \"kubernetes.io/projected/acfb2809-3b99-4247-a1d6-caad05a182b8-kube-api-access-jw46q\") pod \"managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2\" (UID: \"acfb2809-3b99-4247-a1d6-caad05a182b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" Jul 14 18:55:12.483912 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.483818 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acfb2809-3b99-4247-a1d6-caad05a182b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2\" (UID: \"acfb2809-3b99-4247-a1d6-caad05a182b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" Jul 14 18:55:12.485993 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.485968 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8mkx4"] Jul 14 18:55:12.487982 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.487963 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-dhvsl"] Jul 14 18:55:12.488067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.488041 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" Jul 14 18:55:12.489902 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.489884 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-dhvsl" Jul 14 18:55:12.490537 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.490519 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 18:55:12.490756 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.490736 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 18:55:12.490843 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.490739 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-kvlcz\"" Jul 14 18:55:12.491992 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.491971 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-x6njc\"" Jul 14 18:55:12.492116 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.492016 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 18:55:12.492116 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.492082 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 18:55:12.500128 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.500106 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8mkx4"] Jul 14 18:55:12.510132 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.510112 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:12.513260 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.513218 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:12.513425 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.513402 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-dhvsl"] Jul 14 18:55:12.584904 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.584871 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-ca\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.585078 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.584917 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8503de4-812a-4304-a9ac-1418472d5ea9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8mkx4\" (UID: \"e8503de4-812a-4304-a9ac-1418472d5ea9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" Jul 14 18:55:12.585078 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.584947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52bf56c1-aee8-413d-9037-b1bbf6801e8d-tmp\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.585078 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/52bf56c1-aee8-413d-9037-b1bbf6801e8d-klusterlet-config\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.585078 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-hub\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.585078 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw46q\" (UniqueName: \"kubernetes.io/projected/acfb2809-3b99-4247-a1d6-caad05a182b8-kube-api-access-jw46q\") pod \"managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2\" (UID: \"acfb2809-3b99-4247-a1d6-caad05a182b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" Jul 14 18:55:12.585429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.585429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585111 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.585429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acfb2809-3b99-4247-a1d6-caad05a182b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2\" (UID: \"acfb2809-3b99-4247-a1d6-caad05a182b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" Jul 14 18:55:12.585429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585163 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjr9n\" (UniqueName: \"kubernetes.io/projected/cf151b45-69c0-4b3d-a825-99ab17f1a217-kube-api-access-rjr9n\") pod \"downloads-68c9cbb497-dhvsl\" (UID: \"cf151b45-69c0-4b3d-a825-99ab17f1a217\") " pod="openshift-console/downloads-68c9cbb497-dhvsl" Jul 14 18:55:12.585429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585195 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9809103-69c4-40dd-83fd-4bf3de71c0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.585429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhnwl\" (UniqueName: \"kubernetes.io/projected/52bf56c1-aee8-413d-9037-b1bbf6801e8d-kube-api-access-bhnwl\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.585429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8503de4-812a-4304-a9ac-1418472d5ea9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8mkx4\" (UID: \"e8503de4-812a-4304-a9ac-1418472d5ea9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" Jul 14 18:55:12.585429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5cx\" (UniqueName: \"kubernetes.io/projected/a9809103-69c4-40dd-83fd-4bf3de71c0c3-kube-api-access-zw5cx\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.585881 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.585498 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/52bf56c1-aee8-413d-9037-b1bbf6801e8d-tmp\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.588050 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.588025 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acfb2809-3b99-4247-a1d6-caad05a182b8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2\" (UID: \"acfb2809-3b99-4247-a1d6-caad05a182b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" Jul 14 18:55:12.588286 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.588263 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/52bf56c1-aee8-413d-9037-b1bbf6801e8d-klusterlet-config\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.600091 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.600069 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw46q\" (UniqueName: \"kubernetes.io/projected/acfb2809-3b99-4247-a1d6-caad05a182b8-kube-api-access-jw46q\") pod \"managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2\" (UID: \"acfb2809-3b99-4247-a1d6-caad05a182b8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" Jul 14 18:55:12.600173 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.600128 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhnwl\" (UniqueName: \"kubernetes.io/projected/52bf56c1-aee8-413d-9037-b1bbf6801e8d-kube-api-access-bhnwl\") pod \"klusterlet-addon-workmgr-75bf497cf5-rmfvn\" (UID: \"52bf56c1-aee8-413d-9037-b1bbf6801e8d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.609606 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.609583 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:12.611172 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.611150 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b9c76f644-m2sfm" Jul 14 18:55:12.686806 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.686723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8503de4-812a-4304-a9ac-1418472d5ea9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8mkx4\" (UID: \"e8503de4-812a-4304-a9ac-1418472d5ea9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" Jul 14 18:55:12.686957 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.686822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5cx\" (UniqueName: \"kubernetes.io/projected/a9809103-69c4-40dd-83fd-4bf3de71c0c3-kube-api-access-zw5cx\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.687550 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.687361 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-ca\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.687550 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.687424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8503de4-812a-4304-a9ac-1418472d5ea9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8mkx4\" (UID: \"e8503de4-812a-4304-a9ac-1418472d5ea9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" Jul 14 18:55:12.687550 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.687477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-hub\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.687847 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.687821 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.688014 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.687994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.688150 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.688133 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjr9n\" (UniqueName: \"kubernetes.io/projected/cf151b45-69c0-4b3d-a825-99ab17f1a217-kube-api-access-rjr9n\") pod \"downloads-68c9cbb497-dhvsl\" (UID: \"cf151b45-69c0-4b3d-a825-99ab17f1a217\") " pod="openshift-console/downloads-68c9cbb497-dhvsl" Jul 14 18:55:12.688336 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.688318 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9809103-69c4-40dd-83fd-4bf3de71c0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.688656 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.688138 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e8503de4-812a-4304-a9ac-1418472d5ea9-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8mkx4\" (UID: \"e8503de4-812a-4304-a9ac-1418472d5ea9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" Jul 14 18:55:12.689936 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.689137 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9809103-69c4-40dd-83fd-4bf3de71c0c3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.690295 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.690161 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e8503de4-812a-4304-a9ac-1418472d5ea9-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8mkx4\" (UID: \"e8503de4-812a-4304-a9ac-1418472d5ea9\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" Jul 14 18:55:12.690568 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.690548 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-ca\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.691217 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.691185 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-hub\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.692527 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.692484 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.692658 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.692638 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a9809103-69c4-40dd-83fd-4bf3de71c0c3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.697341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.697118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" Jul 14 18:55:12.699887 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.699470 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5cx\" (UniqueName: \"kubernetes.io/projected/a9809103-69c4-40dd-83fd-4bf3de71c0c3-kube-api-access-zw5cx\") pod \"cluster-proxy-proxy-agent-6c978b5494-vhhkq\" (UID: \"a9809103-69c4-40dd-83fd-4bf3de71c0c3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.700327 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.700311 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjr9n\" (UniqueName: \"kubernetes.io/projected/cf151b45-69c0-4b3d-a825-99ab17f1a217-kube-api-access-rjr9n\") pod \"downloads-68c9cbb497-dhvsl\" (UID: \"cf151b45-69c0-4b3d-a825-99ab17f1a217\") " pod="openshift-console/downloads-68c9cbb497-dhvsl" Jul 14 18:55:12.722503 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.722183 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:12.744415 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.744336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" Jul 14 18:55:12.816692 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.816326 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" Jul 14 18:55:12.822377 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.822151 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-dhvsl" Jul 14 18:55:12.870979 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.870755 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2"] Jul 14 18:55:12.876623 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:12.876583 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacfb2809_3b99_4247_a1d6_caad05a182b8.slice/crio-a83f71c5fd07f71d0319f7e16ea1f901a14f4454043fd631e59bc51838ee3bc5 WatchSource:0}: Error finding container a83f71c5fd07f71d0319f7e16ea1f901a14f4454043fd631e59bc51838ee3bc5: Status 404 returned error can't find the container with id a83f71c5fd07f71d0319f7e16ea1f901a14f4454043fd631e59bc51838ee3bc5 Jul 14 18:55:12.892030 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.891958 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn"] Jul 14 18:55:12.944622 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:12.944007 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq"] Jul 14 18:55:12.948277 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:12.948228 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9809103_69c4_40dd_83fd_4bf3de71c0c3.slice/crio-f6c8b42baf776eaf55143ac9d7417e84bc1c03226fe03c58c9f4365d7761daf8 WatchSource:0}: Error finding container f6c8b42baf776eaf55143ac9d7417e84bc1c03226fe03c58c9f4365d7761daf8: Status 404 returned error can't find the container with id f6c8b42baf776eaf55143ac9d7417e84bc1c03226fe03c58c9f4365d7761daf8 Jul 14 18:55:13.009173 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:13.009033 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-dhvsl"] Jul 14 18:55:13.011867 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:13.011835 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf151b45_69c0_4b3d_a825_99ab17f1a217.slice/crio-0b3494b12cfe86cee8d9141c3e11ce732f3aac1926ce6cbc26905afc3591c05d WatchSource:0}: Error finding container 0b3494b12cfe86cee8d9141c3e11ce732f3aac1926ce6cbc26905afc3591c05d: Status 404 returned error can't find the container with id 0b3494b12cfe86cee8d9141c3e11ce732f3aac1926ce6cbc26905afc3591c05d Jul 14 18:55:13.030181 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:13.030159 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8mkx4"] Jul 14 18:55:13.032384 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:13.032362 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8503de4_812a_4304_a9ac_1418472d5ea9.slice/crio-7c4c1bc4aaf0bcf74197ed4a28966c1d4b4f5933592002e3781059ffee62878d WatchSource:0}: Error finding container 7c4c1bc4aaf0bcf74197ed4a28966c1d4b4f5933592002e3781059ffee62878d: Status 404 returned error can't find the container with id 7c4c1bc4aaf0bcf74197ed4a28966c1d4b4f5933592002e3781059ffee62878d Jul 14 18:55:13.618603 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:13.618561 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" event={"ID":"52bf56c1-aee8-413d-9037-b1bbf6801e8d","Type":"ContainerStarted","Data":"cda69b8a0a3e34ccd36f1d6ff06347c029767074bcfcf9b830af7a057d1beb95"} Jul 14 18:55:13.619920 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:13.619886 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" event={"ID":"acfb2809-3b99-4247-a1d6-caad05a182b8","Type":"ContainerStarted","Data":"a83f71c5fd07f71d0319f7e16ea1f901a14f4454043fd631e59bc51838ee3bc5"} Jul 14 18:55:13.621068 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:13.621040 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-dhvsl" event={"ID":"cf151b45-69c0-4b3d-a825-99ab17f1a217","Type":"ContainerStarted","Data":"0b3494b12cfe86cee8d9141c3e11ce732f3aac1926ce6cbc26905afc3591c05d"} Jul 14 18:55:13.622371 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:13.622348 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" event={"ID":"e8503de4-812a-4304-a9ac-1418472d5ea9","Type":"ContainerStarted","Data":"7c4c1bc4aaf0bcf74197ed4a28966c1d4b4f5933592002e3781059ffee62878d"} Jul 14 18:55:13.623621 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:13.623598 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" event={"ID":"a9809103-69c4-40dd-83fd-4bf3de71c0c3","Type":"ContainerStarted","Data":"f6c8b42baf776eaf55143ac9d7417e84bc1c03226fe03c58c9f4365d7761daf8"} Jul 14 18:55:14.637144 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:14.637072 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" event={"ID":"fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605","Type":"ContainerStarted","Data":"178788ddfaff74da9aed57e3e11d36e37b6d2ba94ed2584386f0542533c39e4a"} Jul 14 18:55:21.612429 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.612379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4wpdm" Jul 14 18:55:21.632789 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.632738 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-xqxx8" podStartSLOduration=42.967582372 podStartE2EDuration="45.632723892s" totalImagesPullingTime="2.66514152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:14.657463971 +0000 UTC m=+78.010287496" watchObservedRunningTime="2026-07-14 18:55:21.632723892 +0000 UTC m=+84.985547474" Jul 14 18:55:21.676727 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.676662 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" event={"ID":"e8503de4-812a-4304-a9ac-1418472d5ea9","Type":"ContainerStarted","Data":"94fb123ced07e2aab8b1c722a7e491683c668e75d0130f170e2932e0e3e5c3bf"} Jul 14 18:55:21.679109 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.679049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" event={"ID":"a9809103-69c4-40dd-83fd-4bf3de71c0c3","Type":"ContainerStarted","Data":"a846836be35eb244cde016b29df3a67287079181f54fb1f77c3e43714efbecf0"} Jul 14 18:55:21.679109 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.679092 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" event={"ID":"a9809103-69c4-40dd-83fd-4bf3de71c0c3","Type":"ContainerStarted","Data":"76bb2f13b1ae5f4906e929ba1ae7e9b98c14ce8f500f1b91fa5ea52b03810b2a"} Jul 14 18:55:21.679330 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.679115 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" event={"ID":"a9809103-69c4-40dd-83fd-4bf3de71c0c3","Type":"ContainerStarted","Data":"d6610daee3f8d0f821dfe7e8735fbf63dc7b9c8162459dbc434437496c92b56d"} Jul 14 18:55:21.680812 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.680784 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" event={"ID":"52bf56c1-aee8-413d-9037-b1bbf6801e8d","Type":"ContainerStarted","Data":"eb333fa5ebce16f7482a046bc78d0cc907f389ea53c1a42f4f39a7019135e53e"} Jul 14 18:55:21.681044 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.680995 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:21.682806 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.682784 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" Jul 14 18:55:21.682912 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.682827 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" event={"ID":"acfb2809-3b99-4247-a1d6-caad05a182b8","Type":"ContainerStarted","Data":"9d64b58f7dc2d87dcd8a084b274b43baf98d227708cb409c17affbdf9bbb13d0"} Jul 14 18:55:21.694989 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.694947 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-8mkx4" podStartSLOduration=1.873873819 podStartE2EDuration="9.694934495s" totalImagesPullingTime="7.821060676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:21.693593211 +0000 UTC m=+85.046416754" watchObservedRunningTime="2026-07-14 18:55:21.694934495 +0000 UTC m=+85.047758046" Jul 14 18:55:21.709676 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.709628 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c4bb4fc6d-87tr2" podStartSLOduration=1.733128122 podStartE2EDuration="9.709615452s" totalImagesPullingTime="7.97648733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:21.708860702 +0000 UTC m=+85.061684241" watchObservedRunningTime="2026-07-14 18:55:21.709615452 +0000 UTC m=+85.062438990" Jul 14 18:55:21.729439 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.729219 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c978b5494-vhhkq" podStartSLOduration=1.802319245 podStartE2EDuration="9.72920323s" totalImagesPullingTime="7.926883985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:21.7285968 +0000 UTC m=+85.081420321" watchObservedRunningTime="2026-07-14 18:55:21.72920323 +0000 UTC m=+85.082026753" Jul 14 18:55:21.748162 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:21.748115 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75bf497cf5-rmfvn" podStartSLOduration=1.769823194 podStartE2EDuration="9.748097839s" totalImagesPullingTime="7.978274645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:21.747517604 +0000 UTC m=+85.100341136" watchObservedRunningTime="2026-07-14 18:55:21.748097839 +0000 UTC m=+85.100921362" Jul 14 18:55:26.138773 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:26.138732 2573 patch_prober.go:28] interesting pod/image-registry-78f6c8468c-kpmzn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 18:55:26.139312 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:26.138796 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" podUID="4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 18:55:28.589363 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:28.589326 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:55:31.949883 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:31.949847 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-srqcb"] Jul 14 18:55:32.081836 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.081802 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.084396 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.084367 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 18:55:32.084525 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.084430 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 18:55:32.084658 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.084633 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 18:55:32.085167 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.084960 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rkcqk\"" Jul 14 18:55:32.085167 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.085016 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 18:55:32.159373 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-tls\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.159628 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.159628 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159467 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spfrk\" (UniqueName: \"kubernetes.io/projected/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-kube-api-access-spfrk\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.159628 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-wtmp\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.159628 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159551 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.159628 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-sys\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.159907 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-root\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.159907 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159739 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-textfile\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.159907 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.159812 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-metrics-client-ca\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261097 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261024 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spfrk\" (UniqueName: \"kubernetes.io/projected/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-kube-api-access-spfrk\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261097 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261070 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-wtmp\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261145 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-sys\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-root\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-textfile\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-metrics-client-ca\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-tls\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261434 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261761 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261437 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-root\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.261761 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261569 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-wtmp\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.262281 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.261935 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-sys\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.262281 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.262113 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.262281 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.262216 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-textfile\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.262507 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.262439 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-metrics-client-ca\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.264280 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.264255 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.264710 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.264688 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-node-exporter-tls\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.271024 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.271000 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spfrk\" (UniqueName: \"kubernetes.io/projected/ad038775-73c3-45c1-a5c9-d6cf8eb627e5-kube-api-access-spfrk\") pod \"node-exporter-srqcb\" (UID: \"ad038775-73c3-45c1-a5c9-d6cf8eb627e5\") " pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:32.394968 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:32.394938 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-srqcb" Jul 14 18:55:34.261888 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:55:34.261859 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad038775_73c3_45c1_a5c9_d6cf8eb627e5.slice/crio-d6da773e811acfc67a8f320d742cafab8198273eb3dd5ccd2ac330595da39566 WatchSource:0}: Error finding container d6da773e811acfc67a8f320d742cafab8198273eb3dd5ccd2ac330595da39566: Status 404 returned error can't find the container with id d6da773e811acfc67a8f320d742cafab8198273eb3dd5ccd2ac330595da39566 Jul 14 18:55:34.752442 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:34.752410 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srqcb" event={"ID":"ad038775-73c3-45c1-a5c9-d6cf8eb627e5","Type":"ContainerStarted","Data":"d6da773e811acfc67a8f320d742cafab8198273eb3dd5ccd2ac330595da39566"} Jul 14 18:55:34.977510 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:34.977432 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f6c8468c-kpmzn"] Jul 14 18:55:35.758941 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:35.758895 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-dhvsl" event={"ID":"cf151b45-69c0-4b3d-a825-99ab17f1a217","Type":"ContainerStarted","Data":"c97b0b021360b56a0a552327cd02578c6fd77b099336ef25028f3dcbf3f75558"} Jul 14 18:55:35.759431 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:35.759126 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-dhvsl" Jul 14 18:55:35.774662 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:35.774631 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-dhvsl" Jul 14 18:55:35.779643 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:35.779557 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-dhvsl" podStartSLOduration=2.153095155 podStartE2EDuration="23.779541468s" totalImagesPullingTime="21.626446313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:35.778255483 +0000 UTC m=+99.131079027" watchObservedRunningTime="2026-07-14 18:55:35.779541468 +0000 UTC m=+99.132365033" Jul 14 18:55:36.573527 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:36.573486 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zg68b" Jul 14 18:55:36.767302 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:36.766293 2573 generic.go:356] "Generic (PLEG): container finished" podID="ad038775-73c3-45c1-a5c9-d6cf8eb627e5" containerID="7d4dda00c05518c50eed30693e12518c0fa994bc5a82c1ba68cb5d7e64967d3f" exitCode=0 Jul 14 18:55:36.767302 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:36.766390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srqcb" event={"ID":"ad038775-73c3-45c1-a5c9-d6cf8eb627e5","Type":"ContainerDied","Data":"7d4dda00c05518c50eed30693e12518c0fa994bc5a82c1ba68cb5d7e64967d3f"} Jul 14 18:55:37.774792 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:37.774702 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srqcb" event={"ID":"ad038775-73c3-45c1-a5c9-d6cf8eb627e5","Type":"ContainerStarted","Data":"dc062686d6ae9d3c7d4b24e070b23ca972c95095309be6c7524149743b5c9753"} Jul 14 18:55:37.774792 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:37.774772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-srqcb" event={"ID":"ad038775-73c3-45c1-a5c9-d6cf8eb627e5","Type":"ContainerStarted","Data":"4ddf4c47e2a5063780378ec0d43848160d9dcf75e11738779761cdf449aac22e"} Jul 14 18:55:37.797109 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:37.797061 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-srqcb" podStartSLOduration=4.555169936 podStartE2EDuration="6.797046053s" totalImagesPullingTime="2.147921955s" totalInitContainerRuntime="93.954162ms" isStatefulPod=true podCreationTimestamp="2026-07-14 18:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:55:37.795644298 +0000 UTC m=+101.148467844" watchObservedRunningTime="2026-07-14 18:55:37.797046053 +0000 UTC m=+101.149869676" Jul 14 18:55:53.840638 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:53.840550 2573 generic.go:356] "Generic (PLEG): container finished" podID="fec65f74-94ce-4780-ba9d-a4230023f010" containerID="9938c5da09df0b82198483ccb6b4634295a58fbf11cc2a6406415b483a418107" exitCode=0 Jul 14 18:55:53.840638 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:53.840624 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" event={"ID":"fec65f74-94ce-4780-ba9d-a4230023f010","Type":"ContainerDied","Data":"9938c5da09df0b82198483ccb6b4634295a58fbf11cc2a6406415b483a418107"} Jul 14 18:55:53.841062 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:53.840943 2573 scope.go:117] "RemoveContainer" containerID="9938c5da09df0b82198483ccb6b4634295a58fbf11cc2a6406415b483a418107" Jul 14 18:55:54.846030 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:54.845997 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-7v722" event={"ID":"fec65f74-94ce-4780-ba9d-a4230023f010","Type":"ContainerStarted","Data":"3ee3371110a75b3f40ab232baa9336fda9cb5a48433a7fb409444a8356789f41"} Jul 14 18:55:59.998074 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:55:59.998035 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" podUID="4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" containerName="registry" containerID="cri-o://6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88" gracePeriod=30 Jul 14 18:56:00.270805 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.270741 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:56:00.397851 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.397822 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-trusted-ca\") pod \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " Jul 14 18:56:00.397994 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.397862 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-image-registry-private-configuration\") pod \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " Jul 14 18:56:00.397994 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.397899 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-certificates\") pod \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " Jul 14 18:56:00.397994 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.397938 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-ca-trust-extracted\") pod \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " Jul 14 18:56:00.397994 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.397974 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-installation-pull-secrets\") pod \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " Jul 14 18:56:00.398150 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.398020 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") pod \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " Jul 14 18:56:00.398150 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.398048 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whls4\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-kube-api-access-whls4\") pod \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " Jul 14 18:56:00.398150 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.398072 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-bound-sa-token\") pod \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\" (UID: \"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d\") " Jul 14 18:56:00.398357 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.398327 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:00.398788 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.398760 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:56:00.400391 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.400362 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:00.400516 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.400496 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:56:00.400655 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.400630 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-kube-api-access-whls4" (OuterVolumeSpecName: "kube-api-access-whls4") pod "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d"). InnerVolumeSpecName "kube-api-access-whls4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:56:00.400732 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.400704 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:56:00.400790 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.400777 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:56:00.406883 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.406857 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" (UID: "4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:56:00.499506 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.499481 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-installation-pull-secrets\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:56:00.499506 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.499504 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:56:00.499635 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.499513 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whls4\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-kube-api-access-whls4\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:56:00.499635 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.499523 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-bound-sa-token\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:56:00.499635 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.499531 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-trusted-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:56:00.499635 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.499540 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-image-registry-private-configuration\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:56:00.499635 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.499548 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-registry-certificates\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:56:00.499635 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.499556 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d-ca-trust-extracted\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:56:00.868208 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.868166 2573 generic.go:356] "Generic (PLEG): container finished" podID="4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" containerID="6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88" exitCode=0 Jul 14 18:56:00.868379 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.868216 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" event={"ID":"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d","Type":"ContainerDied","Data":"6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88"} Jul 14 18:56:00.868379 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.868296 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" event={"ID":"4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d","Type":"ContainerDied","Data":"5d87d9ea673589cdc53dc6d5760947f20e287352ff23099df790ce34efe3bf5c"} Jul 14 18:56:00.868379 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.868313 2573 scope.go:117] "RemoveContainer" containerID="6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88" Jul 14 18:56:00.868482 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.868224 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f6c8468c-kpmzn" Jul 14 18:56:00.877333 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.877307 2573 scope.go:117] "RemoveContainer" containerID="6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88" Jul 14 18:56:00.877590 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:56:00.877569 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88\": container with ID starting with 6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88 not found: ID does not exist" containerID="6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88" Jul 14 18:56:00.877639 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.877599 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88"} err="failed to get container status \"6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88\": rpc error: code = NotFound desc = could not find container \"6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88\": container with ID starting with 6f18be608d26814f37848980bd57431e1a4c9d3466ed98159ca8790dde93fe88 not found: ID does not exist" Jul 14 18:56:00.890210 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.890189 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f6c8468c-kpmzn"] Jul 14 18:56:00.894964 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:00.894940 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78f6c8468c-kpmzn"] Jul 14 18:56:01.175042 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:01.174967 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" path="/var/lib/kubelet/pods/4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d/volumes" Jul 14 18:56:03.885039 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:03.884965 2573 generic.go:356] "Generic (PLEG): container finished" podID="23510c14-feb5-41ec-8400-8f8fbd8df57e" containerID="d0c55253d18f9c09d869ddf4d7bf5ff9959be932e67d046b64aee4d8cbe6b08a" exitCode=0 Jul 14 18:56:03.885039 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:03.885002 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" event={"ID":"23510c14-feb5-41ec-8400-8f8fbd8df57e","Type":"ContainerDied","Data":"d0c55253d18f9c09d869ddf4d7bf5ff9959be932e67d046b64aee4d8cbe6b08a"} Jul 14 18:56:03.885447 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:03.885311 2573 scope.go:117] "RemoveContainer" containerID="d0c55253d18f9c09d869ddf4d7bf5ff9959be932e67d046b64aee4d8cbe6b08a" Jul 14 18:56:04.890711 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:04.890679 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-skc5m" event={"ID":"23510c14-feb5-41ec-8400-8f8fbd8df57e","Type":"ContainerStarted","Data":"6276c9fdfcfea7689caf4d2f83dae2fb06c90aed72c4059a72b10aeb570a69fe"} Jul 14 18:56:09.915009 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:09.914971 2573 generic.go:356] "Generic (PLEG): container finished" podID="986dcd81-a48c-451d-b9c1-9e1b4634171a" containerID="71534188ad5f3242dca678a61d8facb55e6749c66b9494a369b329a789f84fa2" exitCode=0 Jul 14 18:56:09.915473 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:09.915042 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" event={"ID":"986dcd81-a48c-451d-b9c1-9e1b4634171a","Type":"ContainerDied","Data":"71534188ad5f3242dca678a61d8facb55e6749c66b9494a369b329a789f84fa2"} Jul 14 18:56:09.915473 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:09.915400 2573 scope.go:117] "RemoveContainer" containerID="71534188ad5f3242dca678a61d8facb55e6749c66b9494a369b329a789f84fa2" Jul 14 18:56:10.921577 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:56:10.921544 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-p685m" event={"ID":"986dcd81-a48c-451d-b9c1-9e1b4634171a","Type":"ContainerStarted","Data":"a8b6e8988cfdc8b570b749c4441d2caecd74930ce06b5a14e5be217ee8d1c12b"} Jul 14 18:58:49.480722 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.480691 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz"] Jul 14 18:58:49.481124 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.480986 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" containerName="registry" Jul 14 18:58:49.481124 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.480997 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" containerName="registry" Jul 14 18:58:49.481124 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.481053 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ce34ae1-73e4-4d7e-b0d5-c4bdae35613d" containerName="registry" Jul 14 18:58:49.483110 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.483093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.485857 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.485825 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 18:58:49.486134 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.486119 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 18:58:49.486447 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.486423 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 18:58:49.486565 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.486547 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 18:58:49.486674 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.486595 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dxtk8\"" Jul 14 18:58:49.513533 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.513508 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz"] Jul 14 18:58:49.595784 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.595757 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b9311a0-9155-428a-a22e-a84ca911ed93-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.595940 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.595791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvxhs\" (UniqueName: \"kubernetes.io/projected/3b9311a0-9155-428a-a22e-a84ca911ed93-kube-api-access-bvxhs\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.595940 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.595833 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b9311a0-9155-428a-a22e-a84ca911ed93-manifests\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.595940 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.595928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9311a0-9155-428a-a22e-a84ca911ed93-tmp\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.596087 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.595973 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b9311a0-9155-428a-a22e-a84ca911ed93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.696446 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.696415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b9311a0-9155-428a-a22e-a84ca911ed93-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.696578 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.696449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvxhs\" (UniqueName: \"kubernetes.io/projected/3b9311a0-9155-428a-a22e-a84ca911ed93-kube-api-access-bvxhs\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.696578 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.696486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b9311a0-9155-428a-a22e-a84ca911ed93-manifests\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.696578 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.696521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9311a0-9155-428a-a22e-a84ca911ed93-tmp\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.696578 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.696545 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b9311a0-9155-428a-a22e-a84ca911ed93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.696975 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.696954 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3b9311a0-9155-428a-a22e-a84ca911ed93-manifests\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.698817 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.698792 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3b9311a0-9155-428a-a22e-a84ca911ed93-tmp\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.699020 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.699003 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b9311a0-9155-428a-a22e-a84ca911ed93-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.699063 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.699037 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b9311a0-9155-428a-a22e-a84ca911ed93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.721394 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.721370 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvxhs\" (UniqueName: \"kubernetes.io/projected/3b9311a0-9155-428a-a22e-a84ca911ed93-kube-api-access-bvxhs\") pod \"opendatahub-operator-controller-manager-5ff67ccb56-7t4cz\" (UID: \"3b9311a0-9155-428a-a22e-a84ca911ed93\") " pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.793394 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.793334 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:49.933053 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:49.933021 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz"] Jul 14 18:58:49.936550 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:58:49.936523 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9311a0_9155_428a_a22e_a84ca911ed93.slice/crio-41428b578dc9da92a924cffb7c1457b077f80afe476356ad9edd38e5781d2f47 WatchSource:0}: Error finding container 41428b578dc9da92a924cffb7c1457b077f80afe476356ad9edd38e5781d2f47: Status 404 returned error can't find the container with id 41428b578dc9da92a924cffb7c1457b077f80afe476356ad9edd38e5781d2f47 Jul 14 18:58:50.517635 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:50.517602 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" event={"ID":"3b9311a0-9155-428a-a22e-a84ca911ed93","Type":"ContainerStarted","Data":"41428b578dc9da92a924cffb7c1457b077f80afe476356ad9edd38e5781d2f47"} Jul 14 18:58:53.533432 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:53.533349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" event={"ID":"3b9311a0-9155-428a-a22e-a84ca911ed93","Type":"ContainerStarted","Data":"732327f70a39c3124d7ef2275f474b2417048789e238774a06e5c4ea777cff3a"} Jul 14 18:58:54.539304 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:54.539212 2573 generic.go:356] "Generic (PLEG): container finished" podID="3b9311a0-9155-428a-a22e-a84ca911ed93" containerID="732327f70a39c3124d7ef2275f474b2417048789e238774a06e5c4ea777cff3a" exitCode=0 Jul 14 18:58:54.539304 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:54.539281 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" event={"ID":"3b9311a0-9155-428a-a22e-a84ca911ed93","Type":"ContainerDied","Data":"732327f70a39c3124d7ef2275f474b2417048789e238774a06e5c4ea777cff3a"} Jul 14 18:58:55.546551 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:55.546506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" event={"ID":"3b9311a0-9155-428a-a22e-a84ca911ed93","Type":"ContainerStarted","Data":"3b549aa69492fd27af2a7a0c49c594d172ef314cb5608022d37926d0c180f4e4"} Jul 14 18:58:55.547017 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:55.546607 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:58:55.577941 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:55.577882 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" podStartSLOduration=1.794221619 podStartE2EDuration="6.577861548s" totalImagesPullingTime="3.721009688s" totalInitContainerRuntime="1.062630241s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:58:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:58:55.576062849 +0000 UTC m=+298.928886388" watchObservedRunningTime="2026-07-14 18:58:55.577861548 +0000 UTC m=+298.930685070" Jul 14 18:58:57.069250 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:57.069195 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 18:58:57.069963 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:57.069937 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 18:58:57.076923 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:57.076898 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 18:58:57.077655 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:57.077632 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 18:58:57.082750 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:58:57.082721 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 18:59:06.554304 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:06.554275 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5ff67ccb56-7t4cz" Jul 14 18:59:10.606700 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.606665 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm"] Jul 14 18:59:10.609197 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.609176 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.611947 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.611914 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 18:59:10.612164 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.611963 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 18:59:10.612784 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.612763 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bq9wx\"" Jul 14 18:59:10.627383 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.627358 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm"] Jul 14 18:59:10.668995 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.668947 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-tls-certs\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.669167 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.669021 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-tmp\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.669167 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.669059 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xng96\" (UniqueName: \"kubernetes.io/projected/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-kube-api-access-xng96\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.770288 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.770213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-tls-certs\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.770450 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.770323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-tmp\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.770450 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.770351 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xng96\" (UniqueName: \"kubernetes.io/projected/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-kube-api-access-xng96\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.772764 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.772727 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-tmp\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.772921 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.772903 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-tls-certs\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.787098 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.787071 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xng96\" (UniqueName: \"kubernetes.io/projected/815bb7ea-43a1-422b-b7e4-c83ace7bc24d-kube-api-access-xng96\") pod \"kube-auth-proxy-7bd89b4b77-8cwwm\" (UID: \"815bb7ea-43a1-422b-b7e4-c83ace7bc24d\") " pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:10.919002 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:10.918920 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" Jul 14 18:59:11.092061 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:11.092021 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm"] Jul 14 18:59:11.096425 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:59:11.096393 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815bb7ea_43a1_422b_b7e4_c83ace7bc24d.slice/crio-7af6a77bea232ef28d676d69172ef57b4713a1a2afcb03e451bb0327f91e8ee0 WatchSource:0}: Error finding container 7af6a77bea232ef28d676d69172ef57b4713a1a2afcb03e451bb0327f91e8ee0: Status 404 returned error can't find the container with id 7af6a77bea232ef28d676d69172ef57b4713a1a2afcb03e451bb0327f91e8ee0 Jul 14 18:59:11.098906 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:11.098887 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 18:59:11.618542 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:11.618506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" event={"ID":"815bb7ea-43a1-422b-b7e4-c83ace7bc24d","Type":"ContainerStarted","Data":"7af6a77bea232ef28d676d69172ef57b4713a1a2afcb03e451bb0327f91e8ee0"} Jul 14 18:59:12.158686 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.158637 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5z2rs"] Jul 14 18:59:12.161288 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.161263 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:12.165499 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.165475 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 14 18:59:12.184341 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.184308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4b8c\" (UniqueName: \"kubernetes.io/projected/f331d40e-c75a-4f55-a105-3d98c0680b83-kube-api-access-f4b8c\") pod \"model-serving-api-54d89bd5fc-5z2rs\" (UID: \"f331d40e-c75a-4f55-a105-3d98c0680b83\") " pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:12.184468 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.184406 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f331d40e-c75a-4f55-a105-3d98c0680b83-tls-certs\") pod \"model-serving-api-54d89bd5fc-5z2rs\" (UID: \"f331d40e-c75a-4f55-a105-3d98c0680b83\") " pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:12.285534 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.285502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4b8c\" (UniqueName: \"kubernetes.io/projected/f331d40e-c75a-4f55-a105-3d98c0680b83-kube-api-access-f4b8c\") pod \"model-serving-api-54d89bd5fc-5z2rs\" (UID: \"f331d40e-c75a-4f55-a105-3d98c0680b83\") " pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:12.285699 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.285561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f331d40e-c75a-4f55-a105-3d98c0680b83-tls-certs\") pod \"model-serving-api-54d89bd5fc-5z2rs\" (UID: \"f331d40e-c75a-4f55-a105-3d98c0680b83\") " pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:12.285699 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:59:12.285656 2573 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 14 18:59:12.285773 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:59:12.285708 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f331d40e-c75a-4f55-a105-3d98c0680b83-tls-certs podName:f331d40e-c75a-4f55-a105-3d98c0680b83 nodeName:}" failed. No retries permitted until 2026-07-14 18:59:12.785692185 +0000 UTC m=+316.138515685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f331d40e-c75a-4f55-a105-3d98c0680b83-tls-certs") pod "model-serving-api-54d89bd5fc-5z2rs" (UID: "f331d40e-c75a-4f55-a105-3d98c0680b83") : secret "model-serving-api-tls" not found Jul 14 18:59:12.312424 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.312391 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4b8c\" (UniqueName: \"kubernetes.io/projected/f331d40e-c75a-4f55-a105-3d98c0680b83-kube-api-access-f4b8c\") pod \"model-serving-api-54d89bd5fc-5z2rs\" (UID: \"f331d40e-c75a-4f55-a105-3d98c0680b83\") " pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:12.363463 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.361380 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5z2rs"] Jul 14 18:59:12.790351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.790299 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f331d40e-c75a-4f55-a105-3d98c0680b83-tls-certs\") pod \"model-serving-api-54d89bd5fc-5z2rs\" (UID: \"f331d40e-c75a-4f55-a105-3d98c0680b83\") " pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:12.792701 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:12.792666 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f331d40e-c75a-4f55-a105-3d98c0680b83-tls-certs\") pod \"model-serving-api-54d89bd5fc-5z2rs\" (UID: \"f331d40e-c75a-4f55-a105-3d98c0680b83\") " pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:13.072619 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.072583 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:13.120876 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.120847 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j"] Jul 14 18:59:13.123634 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.123280 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.127656 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.127317 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 14 18:59:13.127656 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.127373 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 14 18:59:13.127656 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.127402 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 14 18:59:13.127892 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.127677 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qx2j6\"" Jul 14 18:59:13.127892 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.127722 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 14 18:59:13.149908 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.149861 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j"] Jul 14 18:59:13.194138 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.194093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n82nr\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-kube-api-access-n82nr\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.194325 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.194219 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4afce2a-af25-43e8-bf6e-4cab97cb283a-local-certs\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.194325 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.194300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.194414 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.194338 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.194414 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.194383 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-cacerts\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.194476 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.194427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-token\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.194508 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.194470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.231335 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.231303 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5z2rs"] Jul 14 18:59:13.236000 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:59:13.235968 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf331d40e_c75a_4f55_a105_3d98c0680b83.slice/crio-9616a87afd0a1898b705e47969a71ef3704f89dbf3dc1e75e58a6e0ccd7cd91a WatchSource:0}: Error finding container 9616a87afd0a1898b705e47969a71ef3704f89dbf3dc1e75e58a6e0ccd7cd91a: Status 404 returned error can't find the container with id 9616a87afd0a1898b705e47969a71ef3704f89dbf3dc1e75e58a6e0ccd7cd91a Jul 14 18:59:13.295656 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.295622 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4afce2a-af25-43e8-bf6e-4cab97cb283a-local-certs\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.295827 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.295674 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.295898 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.295857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.295967 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.295914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-cacerts\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.295967 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.295948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-token\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.296082 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.295978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.296082 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.296054 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n82nr\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-kube-api-access-n82nr\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.296728 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.296700 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.298460 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.298418 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4afce2a-af25-43e8-bf6e-4cab97cb283a-local-certs\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.298598 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.298577 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.298755 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.298737 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.298819 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.298775 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-cacerts\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.307920 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.307894 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-token\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.308244 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.308212 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n82nr\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-kube-api-access-n82nr\") pod \"istiod-openshift-gateway-7574459656-zxq7j\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.438531 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.438445 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:13.609737 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.609638 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j"] Jul 14 18:59:13.612304 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:59:13.612272 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4afce2a_af25_43e8_bf6e_4cab97cb283a.slice/crio-b1faedd4f457d06c2be83011d678789b34d35cc806243905d838808c629de427 WatchSource:0}: Error finding container b1faedd4f457d06c2be83011d678789b34d35cc806243905d838808c629de427: Status 404 returned error can't find the container with id b1faedd4f457d06c2be83011d678789b34d35cc806243905d838808c629de427 Jul 14 18:59:13.629910 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.629873 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" event={"ID":"f331d40e-c75a-4f55-a105-3d98c0680b83","Type":"ContainerStarted","Data":"9616a87afd0a1898b705e47969a71ef3704f89dbf3dc1e75e58a6e0ccd7cd91a"} Jul 14 18:59:13.631385 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:13.631350 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" event={"ID":"d4afce2a-af25-43e8-bf6e-4cab97cb283a","Type":"ContainerStarted","Data":"b1faedd4f457d06c2be83011d678789b34d35cc806243905d838808c629de427"} Jul 14 18:59:16.739865 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:16.739830 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 14 18:59:16.740132 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:16.739903 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 14 18:59:17.656426 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.656379 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" event={"ID":"d4afce2a-af25-43e8-bf6e-4cab97cb283a","Type":"ContainerStarted","Data":"66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830"} Jul 14 18:59:17.656639 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.656556 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:17.658065 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.658036 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" event={"ID":"815bb7ea-43a1-422b-b7e4-c83ace7bc24d","Type":"ContainerStarted","Data":"66ffd95d1a469c93b4200edf523b9bbf087e68c7b66202c31fbb36ec7fc32ba7"} Jul 14 18:59:17.658577 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.658551 2573 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-zxq7j container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 14 18:59:17.658733 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.658617 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" podUID="d4afce2a-af25-43e8-bf6e-4cab97cb283a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 18:59:17.659775 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.659755 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" event={"ID":"f331d40e-c75a-4f55-a105-3d98c0680b83","Type":"ContainerStarted","Data":"497b08fa65bc5f1724351effa82193d1433ac90d03eafbfd6577a2c1b1994d29"} Jul 14 18:59:17.659899 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.659883 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:17.682107 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.682058 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" podStartSLOduration=1.55695404 podStartE2EDuration="4.682042191s" totalImagesPullingTime="3.125088151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:59:17.680535248 +0000 UTC m=+321.033358794" watchObservedRunningTime="2026-07-14 18:59:17.682042191 +0000 UTC m=+321.034865713" Jul 14 18:59:17.705381 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.705337 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bd89b4b77-8cwwm" podStartSLOduration=2.065437357 podStartE2EDuration="7.70532638s" totalImagesPullingTime="5.639889023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:59:17.704463997 +0000 UTC m=+321.057287536" watchObservedRunningTime="2026-07-14 18:59:17.70532638 +0000 UTC m=+321.058149902" Jul 14 18:59:17.729217 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:17.729164 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" podStartSLOduration=2.233743194 podStartE2EDuration="5.729147182s" totalImagesPullingTime="3.495403988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:59:17.726763698 +0000 UTC m=+321.079587220" watchObservedRunningTime="2026-07-14 18:59:17.729147182 +0000 UTC m=+321.081970704" Jul 14 18:59:18.664944 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:18.664917 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:22.413745 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.413715 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6htrt"] Jul 14 18:59:22.416989 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.416970 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:22.421445 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.421421 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xrt5v\"" Jul 14 18:59:22.423361 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.423336 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 14 18:59:22.437987 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.437962 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6htrt"] Jul 14 18:59:22.483941 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.483914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvdlw\" (UniqueName: \"kubernetes.io/projected/2972a7c6-d26e-4805-ac9e-ed548616e587-kube-api-access-rvdlw\") pod \"kserve-controller-manager-d6f4b65b8-6htrt\" (UID: \"2972a7c6-d26e-4805-ac9e-ed548616e587\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:22.484065 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.483957 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2972a7c6-d26e-4805-ac9e-ed548616e587-cert\") pod \"kserve-controller-manager-d6f4b65b8-6htrt\" (UID: \"2972a7c6-d26e-4805-ac9e-ed548616e587\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:22.584758 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.584722 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvdlw\" (UniqueName: \"kubernetes.io/projected/2972a7c6-d26e-4805-ac9e-ed548616e587-kube-api-access-rvdlw\") pod \"kserve-controller-manager-d6f4b65b8-6htrt\" (UID: \"2972a7c6-d26e-4805-ac9e-ed548616e587\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:22.584918 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.584772 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2972a7c6-d26e-4805-ac9e-ed548616e587-cert\") pod \"kserve-controller-manager-d6f4b65b8-6htrt\" (UID: \"2972a7c6-d26e-4805-ac9e-ed548616e587\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:22.587266 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.587215 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2972a7c6-d26e-4805-ac9e-ed548616e587-cert\") pod \"kserve-controller-manager-d6f4b65b8-6htrt\" (UID: \"2972a7c6-d26e-4805-ac9e-ed548616e587\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:22.596670 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.596642 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvdlw\" (UniqueName: \"kubernetes.io/projected/2972a7c6-d26e-4805-ac9e-ed548616e587-kube-api-access-rvdlw\") pod \"kserve-controller-manager-d6f4b65b8-6htrt\" (UID: \"2972a7c6-d26e-4805-ac9e-ed548616e587\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:22.730411 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.730339 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:22.895028 ip-10-0-131-27 kubenswrapper[2573]: W0714 18:59:22.894995 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2972a7c6_d26e_4805_ac9e_ed548616e587.slice/crio-3bdc2b081de3731b39be61cd76a1fbfdcc3a5e61e6fc7b47c7340da292bc8a82 WatchSource:0}: Error finding container 3bdc2b081de3731b39be61cd76a1fbfdcc3a5e61e6fc7b47c7340da292bc8a82: Status 404 returned error can't find the container with id 3bdc2b081de3731b39be61cd76a1fbfdcc3a5e61e6fc7b47c7340da292bc8a82 Jul 14 18:59:22.908821 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:22.908795 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-6htrt"] Jul 14 18:59:23.690821 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:23.690787 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" event={"ID":"2972a7c6-d26e-4805-ac9e-ed548616e587","Type":"ContainerStarted","Data":"3bdc2b081de3731b39be61cd76a1fbfdcc3a5e61e6fc7b47c7340da292bc8a82"} Jul 14 18:59:25.144657 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.144203 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j"] Jul 14 18:59:25.144657 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.144448 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" podUID="d4afce2a-af25-43e8-bf6e-4cab97cb283a" containerName="discovery" containerID="cri-o://66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830" gracePeriod=30 Jul 14 18:59:25.484342 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.484319 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:25.616444 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.616413 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-token\") pod \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " Jul 14 18:59:25.616444 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.616446 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-ca-configmap\") pod \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " Jul 14 18:59:25.616607 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.616491 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n82nr\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-kube-api-access-n82nr\") pod \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " Jul 14 18:59:25.616607 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.616511 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-kubeconfig\") pod \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " Jul 14 18:59:25.616607 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.616532 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4afce2a-af25-43e8-bf6e-4cab97cb283a-local-certs\") pod \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " Jul 14 18:59:25.616607 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.616560 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-dns-cert\") pod \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " Jul 14 18:59:25.616607 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.616594 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-cacerts\") pod \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\" (UID: \"d4afce2a-af25-43e8-bf6e-4cab97cb283a\") " Jul 14 18:59:25.616969 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.616937 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "d4afce2a-af25-43e8-bf6e-4cab97cb283a" (UID: "d4afce2a-af25-43e8-bf6e-4cab97cb283a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 18:59:25.618941 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.618896 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "d4afce2a-af25-43e8-bf6e-4cab97cb283a" (UID: "d4afce2a-af25-43e8-bf6e-4cab97cb283a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:59:25.618941 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.618912 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4afce2a-af25-43e8-bf6e-4cab97cb283a" (UID: "d4afce2a-af25-43e8-bf6e-4cab97cb283a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:59:25.619099 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.619064 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4afce2a-af25-43e8-bf6e-4cab97cb283a-local-certs" (OuterVolumeSpecName: "local-certs") pod "d4afce2a-af25-43e8-bf6e-4cab97cb283a" (UID: "d4afce2a-af25-43e8-bf6e-4cab97cb283a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 18:59:25.619178 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.619155 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-kube-api-access-n82nr" (OuterVolumeSpecName: "kube-api-access-n82nr") pod "d4afce2a-af25-43e8-bf6e-4cab97cb283a" (UID: "d4afce2a-af25-43e8-bf6e-4cab97cb283a"). InnerVolumeSpecName "kube-api-access-n82nr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 18:59:25.619224 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.619207 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "d4afce2a-af25-43e8-bf6e-4cab97cb283a" (UID: "d4afce2a-af25-43e8-bf6e-4cab97cb283a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:59:25.619297 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.619225 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-cacerts" (OuterVolumeSpecName: "cacerts") pod "d4afce2a-af25-43e8-bf6e-4cab97cb283a" (UID: "d4afce2a-af25-43e8-bf6e-4cab97cb283a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 18:59:25.701830 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.701764 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" event={"ID":"2972a7c6-d26e-4805-ac9e-ed548616e587","Type":"ContainerStarted","Data":"bf109768b95335b4e8a60d8846d6b126542ca70496d17a65676da48c3ec197cd"} Jul 14 18:59:25.701940 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.701911 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 18:59:25.703144 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.703121 2573 generic.go:356] "Generic (PLEG): container finished" podID="d4afce2a-af25-43e8-bf6e-4cab97cb283a" containerID="66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830" exitCode=0 Jul 14 18:59:25.703244 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.703159 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" Jul 14 18:59:25.703244 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.703187 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" event={"ID":"d4afce2a-af25-43e8-bf6e-4cab97cb283a","Type":"ContainerDied","Data":"66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830"} Jul 14 18:59:25.703244 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.703217 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j" event={"ID":"d4afce2a-af25-43e8-bf6e-4cab97cb283a","Type":"ContainerDied","Data":"b1faedd4f457d06c2be83011d678789b34d35cc806243905d838808c629de427"} Jul 14 18:59:25.703351 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.703270 2573 scope.go:117] "RemoveContainer" containerID="66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830" Jul 14 18:59:25.711769 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.711747 2573 scope.go:117] "RemoveContainer" containerID="66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830" Jul 14 18:59:25.712024 ip-10-0-131-27 kubenswrapper[2573]: E0714 18:59:25.712004 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830\": container with ID starting with 66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830 not found: ID does not exist" containerID="66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830" Jul 14 18:59:25.712070 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.712032 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830"} err="failed to get container status \"66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830\": rpc error: code = NotFound desc = could not find container \"66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830\": container with ID starting with 66e634ecc1c422734d91d094fe7894d5edb8fca837c4959b045da2eac2c57830 not found: ID does not exist" Jul 14 18:59:25.718011 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.717997 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-token\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:59:25.718067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.718014 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-ca-configmap\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:59:25.718067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.718023 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n82nr\" (UniqueName: \"kubernetes.io/projected/d4afce2a-af25-43e8-bf6e-4cab97cb283a-kube-api-access-n82nr\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:59:25.718067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.718032 2573 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-kubeconfig\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:59:25.718067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.718040 2573 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4afce2a-af25-43e8-bf6e-4cab97cb283a-local-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:59:25.718067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.718048 2573 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-istio-csr-dns-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:59:25.718067 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.718056 2573 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d4afce2a-af25-43e8-bf6e-4cab97cb283a-cacerts\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 18:59:25.768679 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.768633 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" podStartSLOduration=1.285355097 podStartE2EDuration="3.76861903s" totalImagesPullingTime="2.483263933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 18:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 18:59:25.762083172 +0000 UTC m=+329.114906693" watchObservedRunningTime="2026-07-14 18:59:25.76861903 +0000 UTC m=+329.121442551" Jul 14 18:59:25.793966 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.793939 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j"] Jul 14 18:59:25.806268 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:25.806229 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-zxq7j"] Jul 14 18:59:27.176722 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:27.176689 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4afce2a-af25-43e8-bf6e-4cab97cb283a" path="/var/lib/kubelet/pods/d4afce2a-af25-43e8-bf6e-4cab97cb283a/volumes" Jul 14 18:59:28.668796 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:28.668764 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5z2rs" Jul 14 18:59:56.713102 ip-10-0-131-27 kubenswrapper[2573]: I0714 18:59:56.713068 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-6htrt" Jul 14 19:00:11.358193 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.358154 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxpq4"] Jul 14 19:00:11.358685 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.358652 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4afce2a-af25-43e8-bf6e-4cab97cb283a" containerName="discovery" Jul 14 19:00:11.358685 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.358670 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4afce2a-af25-43e8-bf6e-4cab97cb283a" containerName="discovery" Jul 14 19:00:11.358797 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.358756 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4afce2a-af25-43e8-bf6e-4cab97cb283a" containerName="discovery" Jul 14 19:00:11.361118 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.361097 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" Jul 14 19:00:11.363596 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.363577 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vcfhn\"" Jul 14 19:00:11.364302 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.364285 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 19:00:11.364394 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.364348 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 19:00:11.369818 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.369797 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxpq4"] Jul 14 19:00:11.464331 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.464297 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdwzm\" (UniqueName: \"kubernetes.io/projected/ba9ecf87-3275-41bc-80c0-a51a5311b52f-kube-api-access-qdwzm\") pod \"kuadrant-operator-catalog-fxpq4\" (UID: \"ba9ecf87-3275-41bc-80c0-a51a5311b52f\") " pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" Jul 14 19:00:11.564900 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.564866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdwzm\" (UniqueName: \"kubernetes.io/projected/ba9ecf87-3275-41bc-80c0-a51a5311b52f-kube-api-access-qdwzm\") pod \"kuadrant-operator-catalog-fxpq4\" (UID: \"ba9ecf87-3275-41bc-80c0-a51a5311b52f\") " pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" Jul 14 19:00:11.575202 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.575177 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdwzm\" (UniqueName: \"kubernetes.io/projected/ba9ecf87-3275-41bc-80c0-a51a5311b52f-kube-api-access-qdwzm\") pod \"kuadrant-operator-catalog-fxpq4\" (UID: \"ba9ecf87-3275-41bc-80c0-a51a5311b52f\") " pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" Jul 14 19:00:11.672029 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.671947 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" Jul 14 19:00:11.694571 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.694542 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxpq4"] Jul 14 19:00:11.801328 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.801302 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxpq4"] Jul 14 19:00:11.803644 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:00:11.803617 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9ecf87_3275_41bc_80c0_a51a5311b52f.slice/crio-0eb4f5fff82545bf6fb47e9f1bfb3ec8a82bf4b0809e519be82d7c24cd149927 WatchSource:0}: Error finding container 0eb4f5fff82545bf6fb47e9f1bfb3ec8a82bf4b0809e519be82d7c24cd149927: Status 404 returned error can't find the container with id 0eb4f5fff82545bf6fb47e9f1bfb3ec8a82bf4b0809e519be82d7c24cd149927 Jul 14 19:00:11.906916 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.906874 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" event={"ID":"ba9ecf87-3275-41bc-80c0-a51a5311b52f","Type":"ContainerStarted","Data":"0eb4f5fff82545bf6fb47e9f1bfb3ec8a82bf4b0809e519be82d7c24cd149927"} Jul 14 19:00:11.907473 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.907452 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xpft7"] Jul 14 19:00:11.910287 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.910270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:11.922249 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.922191 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xpft7"] Jul 14 19:00:11.967914 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:11.967883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpmf6\" (UniqueName: \"kubernetes.io/projected/e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d-kube-api-access-cpmf6\") pod \"kuadrant-operator-catalog-xpft7\" (UID: \"e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d\") " pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:12.068981 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:12.068946 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpmf6\" (UniqueName: \"kubernetes.io/projected/e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d-kube-api-access-cpmf6\") pod \"kuadrant-operator-catalog-xpft7\" (UID: \"e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d\") " pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:12.086026 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:12.086002 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpmf6\" (UniqueName: \"kubernetes.io/projected/e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d-kube-api-access-cpmf6\") pod \"kuadrant-operator-catalog-xpft7\" (UID: \"e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d\") " pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:12.219698 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:12.219624 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:12.349272 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:12.349223 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xpft7"] Jul 14 19:00:12.912441 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:12.912407 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" event={"ID":"e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d","Type":"ContainerStarted","Data":"6b98ab41f9c1c61e263d05493f63543b56c29a6c6fed91b07883c4ad70090638"} Jul 14 19:00:14.923281 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:14.923227 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" event={"ID":"ba9ecf87-3275-41bc-80c0-a51a5311b52f","Type":"ContainerStarted","Data":"acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232"} Jul 14 19:00:14.923690 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:14.923330 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" podUID="ba9ecf87-3275-41bc-80c0-a51a5311b52f" containerName="registry-server" containerID="cri-o://acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232" gracePeriod=2 Jul 14 19:00:14.924903 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:14.924870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" event={"ID":"e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d","Type":"ContainerStarted","Data":"3d5cd3e6cdd07b56c80507136dd7278966a2e5ee0d33f4a19cd265c29ccde3f2"} Jul 14 19:00:14.944145 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:14.944099 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" podStartSLOduration=1.6246136949999999 podStartE2EDuration="3.944082208s" totalImagesPullingTime="2.319468513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:00:14.943076397 +0000 UTC m=+378.295899939" watchObservedRunningTime="2026-07-14 19:00:14.944082208 +0000 UTC m=+378.296905730" Jul 14 19:00:14.961405 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:14.961358 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" podStartSLOduration=2.186796988 podStartE2EDuration="3.961344916s" totalImagesPullingTime="1.774547928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:00:14.960213538 +0000 UTC m=+378.313037061" watchObservedRunningTime="2026-07-14 19:00:14.961344916 +0000 UTC m=+378.314168461" Jul 14 19:00:15.169503 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.169474 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" Jul 14 19:00:15.194614 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.194548 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdwzm\" (UniqueName: \"kubernetes.io/projected/ba9ecf87-3275-41bc-80c0-a51a5311b52f-kube-api-access-qdwzm\") pod \"ba9ecf87-3275-41bc-80c0-a51a5311b52f\" (UID: \"ba9ecf87-3275-41bc-80c0-a51a5311b52f\") " Jul 14 19:00:15.196767 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.196735 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9ecf87-3275-41bc-80c0-a51a5311b52f-kube-api-access-qdwzm" (OuterVolumeSpecName: "kube-api-access-qdwzm") pod "ba9ecf87-3275-41bc-80c0-a51a5311b52f" (UID: "ba9ecf87-3275-41bc-80c0-a51a5311b52f"). InnerVolumeSpecName "kube-api-access-qdwzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:00:15.296187 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.296158 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdwzm\" (UniqueName: \"kubernetes.io/projected/ba9ecf87-3275-41bc-80c0-a51a5311b52f-kube-api-access-qdwzm\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:00:15.931824 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.931780 2573 generic.go:356] "Generic (PLEG): container finished" podID="ba9ecf87-3275-41bc-80c0-a51a5311b52f" containerID="acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232" exitCode=0 Jul 14 19:00:15.932272 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.931844 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" Jul 14 19:00:15.932272 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.931860 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" event={"ID":"ba9ecf87-3275-41bc-80c0-a51a5311b52f","Type":"ContainerDied","Data":"acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232"} Jul 14 19:00:15.932272 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.931932 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fxpq4" event={"ID":"ba9ecf87-3275-41bc-80c0-a51a5311b52f","Type":"ContainerDied","Data":"0eb4f5fff82545bf6fb47e9f1bfb3ec8a82bf4b0809e519be82d7c24cd149927"} Jul 14 19:00:15.932272 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.931951 2573 scope.go:117] "RemoveContainer" containerID="acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232" Jul 14 19:00:15.942691 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.942671 2573 scope.go:117] "RemoveContainer" containerID="acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232" Jul 14 19:00:15.942977 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:00:15.942958 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232\": container with ID starting with acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232 not found: ID does not exist" containerID="acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232" Jul 14 19:00:15.943047 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.942999 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232"} err="failed to get container status \"acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232\": rpc error: code = NotFound desc = could not find container \"acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232\": container with ID starting with acbf34018fc639f6dcf852ee483b5a011c430dcff4a34ae18ddbb44976303232 not found: ID does not exist" Jul 14 19:00:15.955822 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.955797 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxpq4"] Jul 14 19:00:15.961190 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:15.961164 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fxpq4"] Jul 14 19:00:17.174786 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:17.174751 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9ecf87-3275-41bc-80c0-a51a5311b52f" path="/var/lib/kubelet/pods/ba9ecf87-3275-41bc-80c0-a51a5311b52f/volumes" Jul 14 19:00:22.220366 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:22.220333 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:22.220733 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:22.220383 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:22.242118 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:22.242093 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:22.989081 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:22.989051 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xpft7" Jul 14 19:00:43.704687 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.704656 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm"] Jul 14 19:00:43.705105 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.704980 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9ecf87-3275-41bc-80c0-a51a5311b52f" containerName="registry-server" Jul 14 19:00:43.705105 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.704994 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9ecf87-3275-41bc-80c0-a51a5311b52f" containerName="registry-server" Jul 14 19:00:43.705105 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.705063 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9ecf87-3275-41bc-80c0-a51a5311b52f" containerName="registry-server" Jul 14 19:00:43.708837 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.708786 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" Jul 14 19:00:43.711793 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.711771 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 14 19:00:43.711793 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.711781 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lfb42\"" Jul 14 19:00:43.719841 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.719818 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm"] Jul 14 19:00:43.834568 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.834537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp9rw\" (UniqueName: \"kubernetes.io/projected/8106d515-670e-4e64-90a7-7d92a974842e-kube-api-access-dp9rw\") pod \"dns-operator-controller-manager-864dd78c4c-mk5fm\" (UID: \"8106d515-670e-4e64-90a7-7d92a974842e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" Jul 14 19:00:43.935624 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.935587 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp9rw\" (UniqueName: \"kubernetes.io/projected/8106d515-670e-4e64-90a7-7d92a974842e-kube-api-access-dp9rw\") pod \"dns-operator-controller-manager-864dd78c4c-mk5fm\" (UID: \"8106d515-670e-4e64-90a7-7d92a974842e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" Jul 14 19:00:43.945146 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:43.945111 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp9rw\" (UniqueName: \"kubernetes.io/projected/8106d515-670e-4e64-90a7-7d92a974842e-kube-api-access-dp9rw\") pod \"dns-operator-controller-manager-864dd78c4c-mk5fm\" (UID: \"8106d515-670e-4e64-90a7-7d92a974842e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" Jul 14 19:00:44.019705 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:44.019626 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" Jul 14 19:00:44.157105 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:44.157080 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm"] Jul 14 19:00:44.159339 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:00:44.159309 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8106d515_670e_4e64_90a7_7d92a974842e.slice/crio-e4de3d23e23471a13840377428d93827d81aeb8edce39f11eb3f01c176bdb8f3 WatchSource:0}: Error finding container e4de3d23e23471a13840377428d93827d81aeb8edce39f11eb3f01c176bdb8f3: Status 404 returned error can't find the container with id e4de3d23e23471a13840377428d93827d81aeb8edce39f11eb3f01c176bdb8f3 Jul 14 19:00:45.064044 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:45.064011 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" event={"ID":"8106d515-670e-4e64-90a7-7d92a974842e","Type":"ContainerStarted","Data":"e4de3d23e23471a13840377428d93827d81aeb8edce39f11eb3f01c176bdb8f3"} Jul 14 19:00:47.076445 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:47.076414 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" event={"ID":"8106d515-670e-4e64-90a7-7d92a974842e","Type":"ContainerStarted","Data":"6523cc43192020561ee2a2b2df82b98c2a05f2fe74ad7d3ad79d66d0a4d47ff1"} Jul 14 19:00:47.076811 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:47.076483 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" Jul 14 19:00:47.158128 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:47.158082 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" podStartSLOduration=1.615903963 podStartE2EDuration="4.158066153s" totalImagesPullingTime="2.54216219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:00:47.155849247 +0000 UTC m=+410.508672781" watchObservedRunningTime="2026-07-14 19:00:47.158066153 +0000 UTC m=+410.510889674" Jul 14 19:00:48.152284 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.152251 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-59hlf"] Jul 14 19:00:48.154490 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.154473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" Jul 14 19:00:48.161302 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.161266 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tg6g6\"" Jul 14 19:00:48.169170 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.169143 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-59hlf"] Jul 14 19:00:48.270374 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.270336 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtrhh\" (UniqueName: \"kubernetes.io/projected/8d3ecf7f-d69e-4c60-9ea9-be54b020afcf-kube-api-access-rtrhh\") pod \"authorino-operator-75cc8d5cb7-59hlf\" (UID: \"8d3ecf7f-d69e-4c60-9ea9-be54b020afcf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" Jul 14 19:00:48.371620 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.371569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtrhh\" (UniqueName: \"kubernetes.io/projected/8d3ecf7f-d69e-4c60-9ea9-be54b020afcf-kube-api-access-rtrhh\") pod \"authorino-operator-75cc8d5cb7-59hlf\" (UID: \"8d3ecf7f-d69e-4c60-9ea9-be54b020afcf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" Jul 14 19:00:48.395365 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.395341 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtrhh\" (UniqueName: \"kubernetes.io/projected/8d3ecf7f-d69e-4c60-9ea9-be54b020afcf-kube-api-access-rtrhh\") pod \"authorino-operator-75cc8d5cb7-59hlf\" (UID: \"8d3ecf7f-d69e-4c60-9ea9-be54b020afcf\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" Jul 14 19:00:48.464227 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.464159 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" Jul 14 19:00:48.605094 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:48.605059 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-59hlf"] Jul 14 19:00:48.609265 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:00:48.609211 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3ecf7f_d69e_4c60_9ea9_be54b020afcf.slice/crio-2171075994c486c6a2d39299aa86a4271ffc77aca224e1b6a07e7fa5869dab6d WatchSource:0}: Error finding container 2171075994c486c6a2d39299aa86a4271ffc77aca224e1b6a07e7fa5869dab6d: Status 404 returned error can't find the container with id 2171075994c486c6a2d39299aa86a4271ffc77aca224e1b6a07e7fa5869dab6d Jul 14 19:00:49.095185 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:49.095151 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" event={"ID":"8d3ecf7f-d69e-4c60-9ea9-be54b020afcf","Type":"ContainerStarted","Data":"2171075994c486c6a2d39299aa86a4271ffc77aca224e1b6a07e7fa5869dab6d"} Jul 14 19:00:51.274199 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.274164 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz"] Jul 14 19:00:51.277410 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.277389 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:00:51.281399 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.281346 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-c6cnh\"" Jul 14 19:00:51.294454 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.294434 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz"] Jul 14 19:00:51.399597 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.399564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsc2d\" (UniqueName: \"kubernetes.io/projected/2d7772eb-f92e-4e5e-9379-4bcdfc2b1911-kube-api-access-wsc2d\") pod \"limitador-operator-controller-manager-859d7b78bd-4dhqz\" (UID: \"2d7772eb-f92e-4e5e-9379-4bcdfc2b1911\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:00:51.500764 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.500732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsc2d\" (UniqueName: \"kubernetes.io/projected/2d7772eb-f92e-4e5e-9379-4bcdfc2b1911-kube-api-access-wsc2d\") pod \"limitador-operator-controller-manager-859d7b78bd-4dhqz\" (UID: \"2d7772eb-f92e-4e5e-9379-4bcdfc2b1911\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:00:51.512406 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.512383 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsc2d\" (UniqueName: \"kubernetes.io/projected/2d7772eb-f92e-4e5e-9379-4bcdfc2b1911-kube-api-access-wsc2d\") pod \"limitador-operator-controller-manager-859d7b78bd-4dhqz\" (UID: \"2d7772eb-f92e-4e5e-9379-4bcdfc2b1911\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:00:51.588317 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.588288 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:00:51.740556 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:51.740527 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz"] Jul 14 19:00:51.743029 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:00:51.742995 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7772eb_f92e_4e5e_9379_4bcdfc2b1911.slice/crio-e9127334806d4101a65dda4c0f680a56c68dd46f2f2f3d4a75fdc15b13e34ca2 WatchSource:0}: Error finding container e9127334806d4101a65dda4c0f680a56c68dd46f2f2f3d4a75fdc15b13e34ca2: Status 404 returned error can't find the container with id e9127334806d4101a65dda4c0f680a56c68dd46f2f2f3d4a75fdc15b13e34ca2 Jul 14 19:00:52.111450 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:52.111410 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" event={"ID":"2d7772eb-f92e-4e5e-9379-4bcdfc2b1911","Type":"ContainerStarted","Data":"e9127334806d4101a65dda4c0f680a56c68dd46f2f2f3d4a75fdc15b13e34ca2"} Jul 14 19:00:54.121554 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:54.121455 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" event={"ID":"8d3ecf7f-d69e-4c60-9ea9-be54b020afcf","Type":"ContainerStarted","Data":"1f0cf7246dfbaf18111b5f3df9050d3ed8d17d7fc4726ea257b98bff5cbbb0cb"} Jul 14 19:00:54.121554 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:54.121532 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" Jul 14 19:00:54.150768 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:54.150720 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" podStartSLOduration=1.277271645 podStartE2EDuration="6.150705781s" totalImagesPullingTime="4.873434136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:00:54.149357646 +0000 UTC m=+417.502181185" watchObservedRunningTime="2026-07-14 19:00:54.150705781 +0000 UTC m=+417.503529301" Jul 14 19:00:55.128669 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:55.128620 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" event={"ID":"2d7772eb-f92e-4e5e-9379-4bcdfc2b1911","Type":"ContainerStarted","Data":"3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c"} Jul 14 19:00:55.159754 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:55.159699 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" podStartSLOduration=1.155668715 podStartE2EDuration="4.15968299s" totalImagesPullingTime="3.004014275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:00:55.155796533 +0000 UTC m=+418.508620067" watchObservedRunningTime="2026-07-14 19:00:55.15968299 +0000 UTC m=+418.512506511" Jul 14 19:00:56.132968 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.132934 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:00:56.763076 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.763034 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z"] Jul 14 19:00:56.766557 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.766536 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:00:56.769781 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.769759 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wbx4n\"" Jul 14 19:00:56.783148 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.783126 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z"] Jul 14 19:00:56.841536 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.841503 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" (UID: \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:00:56.841536 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.841539 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7lnb\" (UniqueName: \"kubernetes.io/projected/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-kube-api-access-s7lnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" (UID: \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:00:56.942645 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.942610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" (UID: \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:00:56.942818 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.942650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7lnb\" (UniqueName: \"kubernetes.io/projected/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-kube-api-access-s7lnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" (UID: \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:00:56.943078 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.943054 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" (UID: \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:00:56.967543 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:56.967518 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7lnb\" (UniqueName: \"kubernetes.io/projected/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-kube-api-access-s7lnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" (UID: \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:00:57.079198 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:57.079164 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wbx4n\"" Jul 14 19:00:57.086394 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:57.086372 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:00:57.246602 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:57.246557 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z"] Jul 14 19:00:57.249163 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:00:57.249133 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda9d49f_039b_4f0f_aa3c_77cacf3f06e0.slice/crio-45dcf0da43f4dab1604e4e92dcbaaf225e7451a7a920730fd8c3fc0469f74b66 WatchSource:0}: Error finding container 45dcf0da43f4dab1604e4e92dcbaaf225e7451a7a920730fd8c3fc0469f74b66: Status 404 returned error can't find the container with id 45dcf0da43f4dab1604e4e92dcbaaf225e7451a7a920730fd8c3fc0469f74b66 Jul 14 19:00:58.083682 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:58.083648 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mk5fm" Jul 14 19:00:58.148722 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:00:58.148677 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" event={"ID":"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0","Type":"ContainerStarted","Data":"45dcf0da43f4dab1604e4e92dcbaaf225e7451a7a920730fd8c3fc0469f74b66"} Jul 14 19:01:05.131314 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:05.131292 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59hlf" Jul 14 19:01:05.185967 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:05.185925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" event={"ID":"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0","Type":"ContainerStarted","Data":"982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05"} Jul 14 19:01:05.186126 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:05.186072 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:05.235264 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:05.235186 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" podStartSLOduration=1.417394239 podStartE2EDuration="9.235170009s" totalImagesPullingTime="7.81777577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:01:05.234584589 +0000 UTC m=+428.587408132" watchObservedRunningTime="2026-07-14 19:01:05.235170009 +0000 UTC m=+428.587993530" Jul 14 19:01:07.143115 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:07.143084 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:01:08.052682 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.052651 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq"] Jul 14 19:01:08.056123 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.056098 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.058546 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.058526 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 19:01:08.058925 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.058905 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 19:01:08.059034 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.059008 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zqq6j\"" Jul 14 19:01:08.081173 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.081146 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq"] Jul 14 19:01:08.124118 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.124087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/52c66130-51eb-4f1d-8c81-3d68cdd78b69-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.124311 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.124123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52c66130-51eb-4f1d-8c81-3d68cdd78b69-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.124311 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.124223 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z58sn\" (UniqueName: \"kubernetes.io/projected/52c66130-51eb-4f1d-8c81-3d68cdd78b69-kube-api-access-z58sn\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.225411 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.225379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/52c66130-51eb-4f1d-8c81-3d68cdd78b69-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.225411 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.225414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52c66130-51eb-4f1d-8c81-3d68cdd78b69-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.225802 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.225593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z58sn\" (UniqueName: \"kubernetes.io/projected/52c66130-51eb-4f1d-8c81-3d68cdd78b69-kube-api-access-z58sn\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.226047 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.226030 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52c66130-51eb-4f1d-8c81-3d68cdd78b69-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.227811 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.227790 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/52c66130-51eb-4f1d-8c81-3d68cdd78b69-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.238146 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.238125 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z58sn\" (UniqueName: \"kubernetes.io/projected/52c66130-51eb-4f1d-8c81-3d68cdd78b69-kube-api-access-z58sn\") pod \"kuadrant-console-plugin-66b5774985-nz7zq\" (UID: \"52c66130-51eb-4f1d-8c81-3d68cdd78b69\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.365714 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.365637 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" Jul 14 19:01:08.503494 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:08.503470 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq"] Jul 14 19:01:08.505187 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:01:08.505158 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52c66130_51eb_4f1d_8c81_3d68cdd78b69.slice/crio-370ac1979394cdad771ffb457b917bbeed1dafd6be6c4f7fd00c1a9424aa6b2b WatchSource:0}: Error finding container 370ac1979394cdad771ffb457b917bbeed1dafd6be6c4f7fd00c1a9424aa6b2b: Status 404 returned error can't find the container with id 370ac1979394cdad771ffb457b917bbeed1dafd6be6c4f7fd00c1a9424aa6b2b Jul 14 19:01:09.205379 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:09.205341 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" event={"ID":"52c66130-51eb-4f1d-8c81-3d68cdd78b69","Type":"ContainerStarted","Data":"370ac1979394cdad771ffb457b917bbeed1dafd6be6c4f7fd00c1a9424aa6b2b"} Jul 14 19:01:16.193775 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:16.193730 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:18.246213 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.246181 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z"] Jul 14 19:01:18.246606 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.246377 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" containerName="manager" containerID="cri-o://982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05" gracePeriod=2 Jul 14 19:01:18.253085 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.253050 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z"] Jul 14 19:01:18.275134 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.275105 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz"] Jul 14 19:01:18.275344 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.275318 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" containerName="manager" containerID="cri-o://3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c" gracePeriod=2 Jul 14 19:01:18.286567 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.286536 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:18.286864 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.286841 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz"] Jul 14 19:01:18.318168 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.318127 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb"] Jul 14 19:01:18.318823 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.318802 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" containerName="manager" Jul 14 19:01:18.318964 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.318952 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" containerName="manager" Jul 14 19:01:18.319078 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.319063 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" containerName="manager" Jul 14 19:01:18.319175 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.319160 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" containerName="manager" Jul 14 19:01:18.319342 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.319302 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" containerName="manager" Jul 14 19:01:18.319342 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.319320 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" containerName="manager" Jul 14 19:01:18.322880 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.322858 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:18.323010 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.322988 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg"] Jul 14 19:01:18.326680 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.326652 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" Jul 14 19:01:18.352162 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.352101 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb"] Jul 14 19:01:18.354967 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.354940 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg"] Jul 14 19:01:18.375832 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.375797 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:18.382028 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.382001 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4dhqz\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:01:18.385135 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.385091 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:18.415006 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.414054 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa951c99-5b3e-4293-b559-b363b8727a08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-txwvb\" (UID: \"aa951c99-5b3e-4293-b559-b363b8727a08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:18.415006 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.414817 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt2q2\" (UniqueName: \"kubernetes.io/projected/e855467b-5dbc-4ce0-93df-0eb30cf4d4fa-kube-api-access-xt2q2\") pod \"limitador-operator-controller-manager-859d7b78bd-r7rvg\" (UID: \"e855467b-5dbc-4ce0-93df-0eb30cf4d4fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" Jul 14 19:01:18.415006 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.414852 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sxx5\" (UniqueName: \"kubernetes.io/projected/aa951c99-5b3e-4293-b559-b363b8727a08-kube-api-access-9sxx5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-txwvb\" (UID: \"aa951c99-5b3e-4293-b559-b363b8727a08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:18.416509 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.416480 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4dhqz\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:01:18.516286 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.516257 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa951c99-5b3e-4293-b559-b363b8727a08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-txwvb\" (UID: \"aa951c99-5b3e-4293-b559-b363b8727a08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:18.516395 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.516300 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2q2\" (UniqueName: \"kubernetes.io/projected/e855467b-5dbc-4ce0-93df-0eb30cf4d4fa-kube-api-access-xt2q2\") pod \"limitador-operator-controller-manager-859d7b78bd-r7rvg\" (UID: \"e855467b-5dbc-4ce0-93df-0eb30cf4d4fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" Jul 14 19:01:18.516395 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.516320 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sxx5\" (UniqueName: \"kubernetes.io/projected/aa951c99-5b3e-4293-b559-b363b8727a08-kube-api-access-9sxx5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-txwvb\" (UID: \"aa951c99-5b3e-4293-b559-b363b8727a08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:18.516626 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.516598 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa951c99-5b3e-4293-b559-b363b8727a08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-txwvb\" (UID: \"aa951c99-5b3e-4293-b559-b363b8727a08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:18.536377 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.536353 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:18.537610 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.537589 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sxx5\" (UniqueName: \"kubernetes.io/projected/aa951c99-5b3e-4293-b559-b363b8727a08-kube-api-access-9sxx5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-txwvb\" (UID: \"aa951c99-5b3e-4293-b559-b363b8727a08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:18.537701 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.537679 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt2q2\" (UniqueName: \"kubernetes.io/projected/e855467b-5dbc-4ce0-93df-0eb30cf4d4fa-kube-api-access-xt2q2\") pod \"limitador-operator-controller-manager-859d7b78bd-r7rvg\" (UID: \"e855467b-5dbc-4ce0-93df-0eb30cf4d4fa\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" Jul 14 19:01:18.538746 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.538720 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:18.539525 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.539507 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:01:18.540941 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.540915 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4dhqz\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:01:18.542765 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.542743 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4dhqz\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:01:18.544554 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:18.544532 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fzr4z\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:18.616797 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.616769 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-extensions-socket-volume\") pod \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\" (UID: \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\") " Jul 14 19:01:18.616974 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.616823 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsc2d\" (UniqueName: \"kubernetes.io/projected/2d7772eb-f92e-4e5e-9379-4bcdfc2b1911-kube-api-access-wsc2d\") pod \"2d7772eb-f92e-4e5e-9379-4bcdfc2b1911\" (UID: \"2d7772eb-f92e-4e5e-9379-4bcdfc2b1911\") " Jul 14 19:01:18.616974 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.616895 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7lnb\" (UniqueName: \"kubernetes.io/projected/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-kube-api-access-s7lnb\") pod \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\" (UID: \"dda9d49f-039b-4f0f-aa3c-77cacf3f06e0\") " Jul 14 19:01:18.617407 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.617345 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" (UID: "dda9d49f-039b-4f0f-aa3c-77cacf3f06e0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:01:18.619032 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.619007 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7772eb-f92e-4e5e-9379-4bcdfc2b1911-kube-api-access-wsc2d" (OuterVolumeSpecName: "kube-api-access-wsc2d") pod "2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" (UID: "2d7772eb-f92e-4e5e-9379-4bcdfc2b1911"). InnerVolumeSpecName "kube-api-access-wsc2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:01:18.619134 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.619084 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-kube-api-access-s7lnb" (OuterVolumeSpecName: "kube-api-access-s7lnb") pod "dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" (UID: "dda9d49f-039b-4f0f-aa3c-77cacf3f06e0"). InnerVolumeSpecName "kube-api-access-s7lnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:01:18.672248 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.672203 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:18.681307 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.681181 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" Jul 14 19:01:18.717714 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.717654 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7lnb\" (UniqueName: \"kubernetes.io/projected/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-kube-api-access-s7lnb\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:01:18.717714 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.717682 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0-extensions-socket-volume\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:01:18.717714 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.717693 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsc2d\" (UniqueName: \"kubernetes.io/projected/2d7772eb-f92e-4e5e-9379-4bcdfc2b1911-kube-api-access-wsc2d\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:01:18.845279 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.845230 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb"] Jul 14 19:01:18.849132 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:01:18.849102 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa951c99_5b3e_4293_b559_b363b8727a08.slice/crio-b3ba95aef2e74a02b13f444f710ccc71fe8590e95c44254b3e90dc7052641388 WatchSource:0}: Error finding container b3ba95aef2e74a02b13f444f710ccc71fe8590e95c44254b3e90dc7052641388: Status 404 returned error can't find the container with id b3ba95aef2e74a02b13f444f710ccc71fe8590e95c44254b3e90dc7052641388 Jul 14 19:01:18.852567 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:18.852531 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg"] Jul 14 19:01:18.854943 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:01:18.854919 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode855467b_5dbc_4ce0_93df_0eb30cf4d4fa.slice/crio-2970c18046cdb7d974181bca4dd0063dfd56b4499ca897a98cc90cbe3bd54c30 WatchSource:0}: Error finding container 2970c18046cdb7d974181bca4dd0063dfd56b4499ca897a98cc90cbe3bd54c30: Status 404 returned error can't find the container with id 2970c18046cdb7d974181bca4dd0063dfd56b4499ca897a98cc90cbe3bd54c30 Jul 14 19:01:19.177375 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.177336 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" path="/var/lib/kubelet/pods/2d7772eb-f92e-4e5e-9379-4bcdfc2b1911/volumes" Jul 14 19:01:19.177791 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.177769 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" path="/var/lib/kubelet/pods/dda9d49f-039b-4f0f-aa3c-77cacf3f06e0/volumes" Jul 14 19:01:19.260071 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.259990 2573 generic.go:356] "Generic (PLEG): container finished" podID="dda9d49f-039b-4f0f-aa3c-77cacf3f06e0" containerID="982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05" exitCode=0 Jul 14 19:01:19.260071 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.260038 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzr4z" Jul 14 19:01:19.260614 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.260103 2573 scope.go:117] "RemoveContainer" containerID="982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05" Jul 14 19:01:19.262692 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.262608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" event={"ID":"e855467b-5dbc-4ce0-93df-0eb30cf4d4fa","Type":"ContainerStarted","Data":"fb796579e29f8c7c9b60935cf453b2d3d28cb8a65f6934209f2944dc77798b16"} Jul 14 19:01:19.262692 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.262661 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" event={"ID":"e855467b-5dbc-4ce0-93df-0eb30cf4d4fa","Type":"ContainerStarted","Data":"2970c18046cdb7d974181bca4dd0063dfd56b4499ca897a98cc90cbe3bd54c30"} Jul 14 19:01:19.262880 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.262775 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" Jul 14 19:01:19.265021 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.264956 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" event={"ID":"aa951c99-5b3e-4293-b559-b363b8727a08","Type":"ContainerStarted","Data":"e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec"} Jul 14 19:01:19.265021 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.265017 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:19.265197 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.265044 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" event={"ID":"aa951c99-5b3e-4293-b559-b363b8727a08","Type":"ContainerStarted","Data":"b3ba95aef2e74a02b13f444f710ccc71fe8590e95c44254b3e90dc7052641388"} Jul 14 19:01:19.266570 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.266544 2573 generic.go:356] "Generic (PLEG): container finished" podID="2d7772eb-f92e-4e5e-9379-4bcdfc2b1911" containerID="3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c" exitCode=0 Jul 14 19:01:19.266710 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.266552 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4dhqz" Jul 14 19:01:19.286007 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.285956 2573 scope.go:117] "RemoveContainer" containerID="982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05" Jul 14 19:01:19.286220 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:19.286203 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05\": container with ID starting with 982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05 not found: ID does not exist" containerID="982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05" Jul 14 19:01:19.286299 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.286273 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05"} err="failed to get container status \"982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05\": rpc error: code = NotFound desc = could not find container \"982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05\": container with ID starting with 982926d8f1002e4e42e833f929ef830baacefa7a73f6fca8d603b35b7eb30b05 not found: ID does not exist" Jul 14 19:01:19.286299 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.286294 2573 scope.go:117] "RemoveContainer" containerID="3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c" Jul 14 19:01:19.295973 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.295948 2573 scope.go:117] "RemoveContainer" containerID="3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c" Jul 14 19:01:19.296555 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:19.296516 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c\": container with ID starting with 3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c not found: ID does not exist" containerID="3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c" Jul 14 19:01:19.296631 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.296563 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c"} err="failed to get container status \"3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c\": rpc error: code = NotFound desc = could not find container \"3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c\": container with ID starting with 3cb341671178e50b1402b0627439f10ba41e1b2fdd9a10bec8f1c82522d72d1c not found: ID does not exist" Jul 14 19:01:19.349564 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.349515 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" podStartSLOduration=1.349498283 podStartE2EDuration="1.349498283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:01:19.299285498 +0000 UTC m=+442.652109033" watchObservedRunningTime="2026-07-14 19:01:19.349498283 +0000 UTC m=+442.702321804" Jul 14 19:01:19.351595 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:19.351548 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" podStartSLOduration=1.351535876 podStartE2EDuration="1.351535876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:01:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:01:19.347883907 +0000 UTC m=+442.700707447" watchObservedRunningTime="2026-07-14 19:01:19.351535876 +0000 UTC m=+442.704359400" Jul 14 19:01:30.275726 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:30.275688 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-r7rvg" Jul 14 19:01:30.276304 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:30.276011 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:36.367853 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:36.367808 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" event={"ID":"52c66130-51eb-4f1d-8c81-3d68cdd78b69","Type":"ContainerStarted","Data":"79e7e2e1a056234f1c745665318987c9a2ce3f196b19a7d4a5750d643eb575e5"} Jul 14 19:01:36.391716 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:36.391664 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nz7zq" podStartSLOduration=1.5579177770000001 podStartE2EDuration="28.391648831s" totalImagesPullingTime="26.833731054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:01:36.390692078 +0000 UTC m=+459.743515618" watchObservedRunningTime="2026-07-14 19:01:36.391648831 +0000 UTC m=+459.744472352" Jul 14 19:01:36.491919 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:36.491889 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb"] Jul 14 19:01:36.492141 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:36.492120 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" podUID="aa951c99-5b3e-4293-b559-b363b8727a08" containerName="manager" containerID="cri-o://e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec" gracePeriod=10 Jul 14 19:01:37.357963 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.357940 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:37.373583 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.373560 2573 generic.go:356] "Generic (PLEG): container finished" podID="aa951c99-5b3e-4293-b559-b363b8727a08" containerID="e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec" exitCode=0 Jul 14 19:01:37.373870 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.373602 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" Jul 14 19:01:37.373870 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.373608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" event={"ID":"aa951c99-5b3e-4293-b559-b363b8727a08","Type":"ContainerDied","Data":"e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec"} Jul 14 19:01:37.373870 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.373663 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb" event={"ID":"aa951c99-5b3e-4293-b559-b363b8727a08","Type":"ContainerDied","Data":"b3ba95aef2e74a02b13f444f710ccc71fe8590e95c44254b3e90dc7052641388"} Jul 14 19:01:37.373870 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.373686 2573 scope.go:117] "RemoveContainer" containerID="e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec" Jul 14 19:01:37.381879 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.381863 2573 scope.go:117] "RemoveContainer" containerID="e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec" Jul 14 19:01:37.382164 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:01:37.382144 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec\": container with ID starting with e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec not found: ID does not exist" containerID="e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec" Jul 14 19:01:37.382270 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.382169 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec"} err="failed to get container status \"e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec\": rpc error: code = NotFound desc = could not find container \"e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec\": container with ID starting with e9a7754946ff0cba311365797a06f5814785babed7129b75e87c9c01ac921bec not found: ID does not exist" Jul 14 19:01:37.489697 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.489624 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sxx5\" (UniqueName: \"kubernetes.io/projected/aa951c99-5b3e-4293-b559-b363b8727a08-kube-api-access-9sxx5\") pod \"aa951c99-5b3e-4293-b559-b363b8727a08\" (UID: \"aa951c99-5b3e-4293-b559-b363b8727a08\") " Jul 14 19:01:37.489697 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.489661 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa951c99-5b3e-4293-b559-b363b8727a08-extensions-socket-volume\") pod \"aa951c99-5b3e-4293-b559-b363b8727a08\" (UID: \"aa951c99-5b3e-4293-b559-b363b8727a08\") " Jul 14 19:01:37.490087 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.490063 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa951c99-5b3e-4293-b559-b363b8727a08-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa951c99-5b3e-4293-b559-b363b8727a08" (UID: "aa951c99-5b3e-4293-b559-b363b8727a08"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 19:01:37.491729 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.491709 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa951c99-5b3e-4293-b559-b363b8727a08-kube-api-access-9sxx5" (OuterVolumeSpecName: "kube-api-access-9sxx5") pod "aa951c99-5b3e-4293-b559-b363b8727a08" (UID: "aa951c99-5b3e-4293-b559-b363b8727a08"). InnerVolumeSpecName "kube-api-access-9sxx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:01:37.590560 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.590530 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sxx5\" (UniqueName: \"kubernetes.io/projected/aa951c99-5b3e-4293-b559-b363b8727a08-kube-api-access-9sxx5\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:01:37.590560 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.590555 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa951c99-5b3e-4293-b559-b363b8727a08-extensions-socket-volume\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:01:37.701280 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.701254 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb"] Jul 14 19:01:37.707317 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:37.707297 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-txwvb"] Jul 14 19:01:39.175388 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:39.175353 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa951c99-5b3e-4293-b559-b363b8727a08" path="/var/lib/kubelet/pods/aa951c99-5b3e-4293-b559-b363b8727a08/volumes" Jul 14 19:01:56.413301 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.413269 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r98mt"] Jul 14 19:01:56.413752 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.413646 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa951c99-5b3e-4293-b559-b363b8727a08" containerName="manager" Jul 14 19:01:56.413752 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.413661 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa951c99-5b3e-4293-b559-b363b8727a08" containerName="manager" Jul 14 19:01:56.413752 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.413721 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa951c99-5b3e-4293-b559-b363b8727a08" containerName="manager" Jul 14 19:01:56.464190 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.464160 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r98mt"] Jul 14 19:01:56.464349 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.464279 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:01:56.467501 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.467478 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 19:01:56.509391 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.509362 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r98mt"] Jul 14 19:01:56.540296 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.540265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4e50119-a98d-4992-bc07-4d5021fc8821-config-file\") pod \"limitador-limitador-64c94fd64f-r98mt\" (UID: \"c4e50119-a98d-4992-bc07-4d5021fc8821\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:01:56.540447 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.540300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zpmz\" (UniqueName: \"kubernetes.io/projected/c4e50119-a98d-4992-bc07-4d5021fc8821-kube-api-access-6zpmz\") pod \"limitador-limitador-64c94fd64f-r98mt\" (UID: \"c4e50119-a98d-4992-bc07-4d5021fc8821\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:01:56.641568 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.641531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4e50119-a98d-4992-bc07-4d5021fc8821-config-file\") pod \"limitador-limitador-64c94fd64f-r98mt\" (UID: \"c4e50119-a98d-4992-bc07-4d5021fc8821\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:01:56.641568 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.641568 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zpmz\" (UniqueName: \"kubernetes.io/projected/c4e50119-a98d-4992-bc07-4d5021fc8821-kube-api-access-6zpmz\") pod \"limitador-limitador-64c94fd64f-r98mt\" (UID: \"c4e50119-a98d-4992-bc07-4d5021fc8821\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:01:56.642176 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.642151 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4e50119-a98d-4992-bc07-4d5021fc8821-config-file\") pod \"limitador-limitador-64c94fd64f-r98mt\" (UID: \"c4e50119-a98d-4992-bc07-4d5021fc8821\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:01:56.651970 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.651942 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zpmz\" (UniqueName: \"kubernetes.io/projected/c4e50119-a98d-4992-bc07-4d5021fc8821-kube-api-access-6zpmz\") pod \"limitador-limitador-64c94fd64f-r98mt\" (UID: \"c4e50119-a98d-4992-bc07-4d5021fc8821\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:01:56.775468 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.775389 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:01:56.923699 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.923617 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r98mt"] Jul 14 19:01:56.924501 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:01:56.924473 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e50119_a98d_4992_bc07_4d5021fc8821.slice/crio-4bc4c97e34e69b6730f3399270c851b8be7b34ea67d99e8cb2417d4ea64a3ea1 WatchSource:0}: Error finding container 4bc4c97e34e69b6730f3399270c851b8be7b34ea67d99e8cb2417d4ea64a3ea1: Status 404 returned error can't find the container with id 4bc4c97e34e69b6730f3399270c851b8be7b34ea67d99e8cb2417d4ea64a3ea1 Jul 14 19:01:56.953262 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.953220 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:01:56.983645 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.983615 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:01:56.983752 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.983717 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:01:56.994126 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:56.994095 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:01:57.044459 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.044394 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83dddc76-f9a0-45ad-beae-c861f2c8bd9a-config-file\") pod \"limitador-limitador-54d6d988d5-t825d\" (UID: \"83dddc76-f9a0-45ad-beae-c861f2c8bd9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:01:57.044459 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.044457 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm79c\" (UniqueName: \"kubernetes.io/projected/83dddc76-f9a0-45ad-beae-c861f2c8bd9a-kube-api-access-hm79c\") pod \"limitador-limitador-54d6d988d5-t825d\" (UID: \"83dddc76-f9a0-45ad-beae-c861f2c8bd9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:01:57.144786 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.144761 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83dddc76-f9a0-45ad-beae-c861f2c8bd9a-config-file\") pod \"limitador-limitador-54d6d988d5-t825d\" (UID: \"83dddc76-f9a0-45ad-beae-c861f2c8bd9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:01:57.144888 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.144826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm79c\" (UniqueName: \"kubernetes.io/projected/83dddc76-f9a0-45ad-beae-c861f2c8bd9a-kube-api-access-hm79c\") pod \"limitador-limitador-54d6d988d5-t825d\" (UID: \"83dddc76-f9a0-45ad-beae-c861f2c8bd9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:01:57.145332 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.145313 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83dddc76-f9a0-45ad-beae-c861f2c8bd9a-config-file\") pod \"limitador-limitador-54d6d988d5-t825d\" (UID: \"83dddc76-f9a0-45ad-beae-c861f2c8bd9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:01:57.155020 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.154998 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm79c\" (UniqueName: \"kubernetes.io/projected/83dddc76-f9a0-45ad-beae-c861f2c8bd9a-kube-api-access-hm79c\") pod \"limitador-limitador-54d6d988d5-t825d\" (UID: \"83dddc76-f9a0-45ad-beae-c861f2c8bd9a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:01:57.302190 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.302159 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:01:57.449244 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.449208 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:01:57.450381 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:01:57.450353 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83dddc76_f9a0_45ad_beae_c861f2c8bd9a.slice/crio-0e0162bbd6fdd0773fc37c73cb30c13138dca729b7793bfbb923eea47a7f0d23 WatchSource:0}: Error finding container 0e0162bbd6fdd0773fc37c73cb30c13138dca729b7793bfbb923eea47a7f0d23: Status 404 returned error can't find the container with id 0e0162bbd6fdd0773fc37c73cb30c13138dca729b7793bfbb923eea47a7f0d23 Jul 14 19:01:57.466708 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.466677 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" event={"ID":"c4e50119-a98d-4992-bc07-4d5021fc8821","Type":"ContainerStarted","Data":"4bc4c97e34e69b6730f3399270c851b8be7b34ea67d99e8cb2417d4ea64a3ea1"} Jul 14 19:01:57.467809 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:01:57.467789 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" event={"ID":"83dddc76-f9a0-45ad-beae-c861f2c8bd9a","Type":"ContainerStarted","Data":"0e0162bbd6fdd0773fc37c73cb30c13138dca729b7793bfbb923eea47a7f0d23"} Jul 14 19:02:02.500054 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:02.500004 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" event={"ID":"83dddc76-f9a0-45ad-beae-c861f2c8bd9a","Type":"ContainerStarted","Data":"bde26bcd6ac8aede04b326bc1c89db45ec3c5eca775fd72de1f56f3b79cc2daa"} Jul 14 19:02:02.500542 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:02.500111 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:02:02.501491 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:02.501467 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" event={"ID":"c4e50119-a98d-4992-bc07-4d5021fc8821","Type":"ContainerStarted","Data":"9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa"} Jul 14 19:02:02.501599 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:02.501533 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:02:02.525560 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:02.525516 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" podStartSLOduration=2.338340517 podStartE2EDuration="6.525502005s" totalImagesPullingTime="4.187161488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:02:02.522853747 +0000 UTC m=+485.875677293" watchObservedRunningTime="2026-07-14 19:02:02.525502005 +0000 UTC m=+485.878325504" Jul 14 19:02:02.543082 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:02.543030 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" podStartSLOduration=1.7565662770000001 podStartE2EDuration="6.543016364s" totalImagesPullingTime="4.786450087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:02:02.541878737 +0000 UTC m=+485.894702259" watchObservedRunningTime="2026-07-14 19:02:02.543016364 +0000 UTC m=+485.895839885" Jul 14 19:02:13.508683 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:13.508647 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-t825d" Jul 14 19:02:13.509079 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:13.508715 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:02:13.585062 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:13.585027 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r98mt"] Jul 14 19:02:13.585269 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:13.585244 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" podUID="c4e50119-a98d-4992-bc07-4d5021fc8821" containerName="limitador" containerID="cri-o://9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa" gracePeriod=30 Jul 14 19:02:14.132428 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.132400 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:02:14.163426 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.163355 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4e50119-a98d-4992-bc07-4d5021fc8821-config-file\") pod \"c4e50119-a98d-4992-bc07-4d5021fc8821\" (UID: \"c4e50119-a98d-4992-bc07-4d5021fc8821\") " Jul 14 19:02:14.163426 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.163404 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zpmz\" (UniqueName: \"kubernetes.io/projected/c4e50119-a98d-4992-bc07-4d5021fc8821-kube-api-access-6zpmz\") pod \"c4e50119-a98d-4992-bc07-4d5021fc8821\" (UID: \"c4e50119-a98d-4992-bc07-4d5021fc8821\") " Jul 14 19:02:14.163703 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.163684 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4e50119-a98d-4992-bc07-4d5021fc8821-config-file" (OuterVolumeSpecName: "config-file") pod "c4e50119-a98d-4992-bc07-4d5021fc8821" (UID: "c4e50119-a98d-4992-bc07-4d5021fc8821"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:02:14.165415 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.165396 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4e50119-a98d-4992-bc07-4d5021fc8821-kube-api-access-6zpmz" (OuterVolumeSpecName: "kube-api-access-6zpmz") pod "c4e50119-a98d-4992-bc07-4d5021fc8821" (UID: "c4e50119-a98d-4992-bc07-4d5021fc8821"). InnerVolumeSpecName "kube-api-access-6zpmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:02:14.264257 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.264208 2573 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4e50119-a98d-4992-bc07-4d5021fc8821-config-file\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:02:14.264257 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.264254 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zpmz\" (UniqueName: \"kubernetes.io/projected/c4e50119-a98d-4992-bc07-4d5021fc8821-kube-api-access-6zpmz\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:02:14.559601 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.559567 2573 generic.go:356] "Generic (PLEG): container finished" podID="c4e50119-a98d-4992-bc07-4d5021fc8821" containerID="9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa" exitCode=0 Jul 14 19:02:14.559990 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.559608 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" Jul 14 19:02:14.559990 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.559659 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" event={"ID":"c4e50119-a98d-4992-bc07-4d5021fc8821","Type":"ContainerDied","Data":"9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa"} Jul 14 19:02:14.559990 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.559714 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r98mt" event={"ID":"c4e50119-a98d-4992-bc07-4d5021fc8821","Type":"ContainerDied","Data":"4bc4c97e34e69b6730f3399270c851b8be7b34ea67d99e8cb2417d4ea64a3ea1"} Jul 14 19:02:14.559990 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.559740 2573 scope.go:117] "RemoveContainer" containerID="9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa" Jul 14 19:02:14.569037 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.569019 2573 scope.go:117] "RemoveContainer" containerID="9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa" Jul 14 19:02:14.569343 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:02:14.569322 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa\": container with ID starting with 9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa not found: ID does not exist" containerID="9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa" Jul 14 19:02:14.569413 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.569350 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa"} err="failed to get container status \"9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa\": rpc error: code = NotFound desc = could not find container \"9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa\": container with ID starting with 9729d4b6525238101bf5cd12b1f393e4d46d2a570112ef7b09f81921b67712fa not found: ID does not exist" Jul 14 19:02:14.582842 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.582807 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r98mt"] Jul 14 19:02:14.586535 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:14.586516 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r98mt"] Jul 14 19:02:15.176251 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:15.176214 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4e50119-a98d-4992-bc07-4d5021fc8821" path="/var/lib/kubelet/pods/c4e50119-a98d-4992-bc07-4d5021fc8821/volumes" Jul 14 19:02:16.866550 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.866512 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rch7h"] Jul 14 19:02:16.866987 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.866904 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4e50119-a98d-4992-bc07-4d5021fc8821" containerName="limitador" Jul 14 19:02:16.866987 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.866915 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4e50119-a98d-4992-bc07-4d5021fc8821" containerName="limitador" Jul 14 19:02:16.867131 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.866998 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4e50119-a98d-4992-bc07-4d5021fc8821" containerName="limitador" Jul 14 19:02:16.871574 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.871551 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:16.877941 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.877919 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 14 19:02:16.878071 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.877942 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 14 19:02:16.878071 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.878046 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 14 19:02:16.878223 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.878203 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jvlx5\"" Jul 14 19:02:16.882156 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.882135 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c200f637-b29a-45ca-915f-ed7d3da171a8-data\") pod \"postgres-69fb4594cf-rch7h\" (UID: \"c200f637-b29a-45ca-915f-ed7d3da171a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:16.882269 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.882164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vgkr\" (UniqueName: \"kubernetes.io/projected/c200f637-b29a-45ca-915f-ed7d3da171a8-kube-api-access-6vgkr\") pod \"postgres-69fb4594cf-rch7h\" (UID: \"c200f637-b29a-45ca-915f-ed7d3da171a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:16.884564 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.884540 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rch7h"] Jul 14 19:02:16.982648 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.982618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c200f637-b29a-45ca-915f-ed7d3da171a8-data\") pod \"postgres-69fb4594cf-rch7h\" (UID: \"c200f637-b29a-45ca-915f-ed7d3da171a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:16.982811 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.982652 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vgkr\" (UniqueName: \"kubernetes.io/projected/c200f637-b29a-45ca-915f-ed7d3da171a8-kube-api-access-6vgkr\") pod \"postgres-69fb4594cf-rch7h\" (UID: \"c200f637-b29a-45ca-915f-ed7d3da171a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:16.983064 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.983036 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c200f637-b29a-45ca-915f-ed7d3da171a8-data\") pod \"postgres-69fb4594cf-rch7h\" (UID: \"c200f637-b29a-45ca-915f-ed7d3da171a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:16.992174 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:16.992153 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vgkr\" (UniqueName: \"kubernetes.io/projected/c200f637-b29a-45ca-915f-ed7d3da171a8-kube-api-access-6vgkr\") pod \"postgres-69fb4594cf-rch7h\" (UID: \"c200f637-b29a-45ca-915f-ed7d3da171a8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:17.182502 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:17.182420 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:17.324756 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:17.324726 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-rch7h"] Jul 14 19:02:17.326536 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:02:17.326501 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc200f637_b29a_45ca_915f_ed7d3da171a8.slice/crio-3be494f49d5f23e1bfe3fcbd87332f89814b7c3ba5385f10835996dcfc53f2bc WatchSource:0}: Error finding container 3be494f49d5f23e1bfe3fcbd87332f89814b7c3ba5385f10835996dcfc53f2bc: Status 404 returned error can't find the container with id 3be494f49d5f23e1bfe3fcbd87332f89814b7c3ba5385f10835996dcfc53f2bc Jul 14 19:02:17.576484 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:17.576449 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" event={"ID":"c200f637-b29a-45ca-915f-ed7d3da171a8","Type":"ContainerStarted","Data":"3be494f49d5f23e1bfe3fcbd87332f89814b7c3ba5385f10835996dcfc53f2bc"} Jul 14 19:02:22.607600 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:22.607558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" event={"ID":"c200f637-b29a-45ca-915f-ed7d3da171a8","Type":"ContainerStarted","Data":"781437b420ad17e3c4f358f6fe0e83010cd999e74b3a321233722350114f3718"} Jul 14 19:02:22.607984 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:22.607630 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:02:22.628093 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:22.628038 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" podStartSLOduration=1.919045755 podStartE2EDuration="6.628023128s" totalImagesPullingTime="4.708977373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:02:22.626635529 +0000 UTC m=+505.979459070" watchObservedRunningTime="2026-07-14 19:02:22.628023128 +0000 UTC m=+505.980846649" Jul 14 19:02:28.642404 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:02:28.642372 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-rch7h" Jul 14 19:03:15.287354 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.287320 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s5kl5"] Jul 14 19:03:15.290114 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.290093 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:15.292504 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.292479 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hxq52\"" Jul 14 19:03:15.292775 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.292758 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 19:03:15.299936 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.299915 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s5kl5"] Jul 14 19:03:15.343749 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.343716 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt"] Jul 14 19:03:15.345891 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.345873 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:15.363645 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.363616 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt"] Jul 14 19:03:15.402117 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.402089 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:03:15.469711 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.469676 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzhw2\" (UniqueName: \"kubernetes.io/projected/624ec147-cb80-4019-a40e-36b28bb83047-kube-api-access-kzhw2\") pod \"payload-processing-f9b8d9b9b-s5kl5\" (UID: \"624ec147-cb80-4019-a40e-36b28bb83047\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:15.469826 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.469729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624ec147-cb80-4019-a40e-36b28bb83047-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s5kl5\" (UID: \"624ec147-cb80-4019-a40e-36b28bb83047\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:15.469826 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.469755 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad7c377d-905a-414d-bc2c-f82b4e1f2c44-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qzqkt\" (UID: \"ad7c377d-905a-414d-bc2c-f82b4e1f2c44\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:15.469826 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.469783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtcd6\" (UniqueName: \"kubernetes.io/projected/ad7c377d-905a-414d-bc2c-f82b4e1f2c44-kube-api-access-gtcd6\") pod \"payload-pre-processing-74584bb9f8-qzqkt\" (UID: \"ad7c377d-905a-414d-bc2c-f82b4e1f2c44\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:15.570800 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.570774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzhw2\" (UniqueName: \"kubernetes.io/projected/624ec147-cb80-4019-a40e-36b28bb83047-kube-api-access-kzhw2\") pod \"payload-processing-f9b8d9b9b-s5kl5\" (UID: \"624ec147-cb80-4019-a40e-36b28bb83047\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:15.570926 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.570806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624ec147-cb80-4019-a40e-36b28bb83047-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s5kl5\" (UID: \"624ec147-cb80-4019-a40e-36b28bb83047\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:15.570988 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.570929 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad7c377d-905a-414d-bc2c-f82b4e1f2c44-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qzqkt\" (UID: \"ad7c377d-905a-414d-bc2c-f82b4e1f2c44\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:15.570988 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.570960 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtcd6\" (UniqueName: \"kubernetes.io/projected/ad7c377d-905a-414d-bc2c-f82b4e1f2c44-kube-api-access-gtcd6\") pod \"payload-pre-processing-74584bb9f8-qzqkt\" (UID: \"ad7c377d-905a-414d-bc2c-f82b4e1f2c44\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:15.571963 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.571916 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad7c377d-905a-414d-bc2c-f82b4e1f2c44-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-qzqkt\" (UID: \"ad7c377d-905a-414d-bc2c-f82b4e1f2c44\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:15.572165 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.572117 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624ec147-cb80-4019-a40e-36b28bb83047-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-s5kl5\" (UID: \"624ec147-cb80-4019-a40e-36b28bb83047\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:15.581006 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.580979 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzhw2\" (UniqueName: \"kubernetes.io/projected/624ec147-cb80-4019-a40e-36b28bb83047-kube-api-access-kzhw2\") pod \"payload-processing-f9b8d9b9b-s5kl5\" (UID: \"624ec147-cb80-4019-a40e-36b28bb83047\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:15.581131 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.581108 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtcd6\" (UniqueName: \"kubernetes.io/projected/ad7c377d-905a-414d-bc2c-f82b4e1f2c44-kube-api-access-gtcd6\") pod \"payload-pre-processing-74584bb9f8-qzqkt\" (UID: \"ad7c377d-905a-414d-bc2c-f82b4e1f2c44\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:15.600935 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.600910 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:15.655402 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.655370 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:15.748283 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.748254 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-s5kl5"] Jul 14 19:03:15.751530 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:03:15.751498 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624ec147_cb80_4019_a40e_36b28bb83047.slice/crio-3c18f092c6654f7046f4837bfc6a8a725f925f13cbc5c83dd1eba02149d24336 WatchSource:0}: Error finding container 3c18f092c6654f7046f4837bfc6a8a725f925f13cbc5c83dd1eba02149d24336: Status 404 returned error can't find the container with id 3c18f092c6654f7046f4837bfc6a8a725f925f13cbc5c83dd1eba02149d24336 Jul 14 19:03:15.794817 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.794736 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt"] Jul 14 19:03:15.797394 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:03:15.797372 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7c377d_905a_414d_bc2c_f82b4e1f2c44.slice/crio-b6c8cfbc9b81ae8e5456b6e1b4969a1f2e1166139664ea18a0ab06698dcfb82f WatchSource:0}: Error finding container b6c8cfbc9b81ae8e5456b6e1b4969a1f2e1166139664ea18a0ab06698dcfb82f: Status 404 returned error can't find the container with id b6c8cfbc9b81ae8e5456b6e1b4969a1f2e1166139664ea18a0ab06698dcfb82f Jul 14 19:03:15.855510 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.855428 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" event={"ID":"ad7c377d-905a-414d-bc2c-f82b4e1f2c44","Type":"ContainerStarted","Data":"b6c8cfbc9b81ae8e5456b6e1b4969a1f2e1166139664ea18a0ab06698dcfb82f"} Jul 14 19:03:15.863482 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:15.863449 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" event={"ID":"624ec147-cb80-4019-a40e-36b28bb83047","Type":"ContainerStarted","Data":"3c18f092c6654f7046f4837bfc6a8a725f925f13cbc5c83dd1eba02149d24336"} Jul 14 19:03:17.875161 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:17.875120 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" event={"ID":"ad7c377d-905a-414d-bc2c-f82b4e1f2c44","Type":"ContainerStarted","Data":"aaf10778343bd4a1102de90ae452c4fc92e9ea4b46c578f581285306f22a5bf1"} Jul 14 19:03:17.875612 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:17.875192 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:17.893132 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:17.893088 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" podStartSLOduration=1.298741549 podStartE2EDuration="2.893075087s" totalImagesPullingTime="1.594333538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:03:17.891774048 +0000 UTC m=+561.244597588" watchObservedRunningTime="2026-07-14 19:03:17.893075087 +0000 UTC m=+561.245898608" Jul 14 19:03:18.884712 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:18.884671 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" event={"ID":"624ec147-cb80-4019-a40e-36b28bb83047","Type":"ContainerStarted","Data":"02b3a1b0def1385ce5d8c9376056951cedb2654488fc741f73b22feda9e9aeb7"} Jul 14 19:03:18.885146 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:18.884846 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:18.904254 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:18.904200 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" podStartSLOduration=1.4143639700000001 podStartE2EDuration="3.904186803s" totalImagesPullingTime="2.489822833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:03:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:03:18.902402665 +0000 UTC m=+562.255226185" watchObservedRunningTime="2026-07-14 19:03:18.904186803 +0000 UTC m=+562.257010323" Jul 14 19:03:28.887185 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:28.887151 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-qzqkt" Jul 14 19:03:29.891718 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:29.891685 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-s5kl5" Jul 14 19:03:32.098441 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:32.098403 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:03:45.182381 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:45.182348 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:03:50.685592 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:50.685557 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:03:56.682324 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:56.682286 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:03:57.099752 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:57.099724 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:03:57.101957 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:57.101935 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:03:57.107137 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:57.107117 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:03:57.109210 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:03:57.109191 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:04:05.776120 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:04:05.776085 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:04:22.119651 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:04:22.119568 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:06:01.499434 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:06:01.499394 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:06:10.782250 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:06:10.782198 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:06:22.482223 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:06:22.482189 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:06:32.181878 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:06:32.181839 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:06:42.673854 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:06:42.673813 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:07:10.889940 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:07:10.889908 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:07:23.776859 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:07:23.776781 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:08:02.385801 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:02.385762 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:08:11.680393 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:11.680355 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:08:21.878734 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:21.878701 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:08:27.976994 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:27.976961 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:08:38.598964 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:38.598928 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:08:47.379666 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:47.379636 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:08:57.129201 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:57.129172 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:08:57.133486 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:57.133463 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:08:57.136358 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:57.136336 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:08:57.140876 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:08:57.140860 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:09:01.591658 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:09:01.591622 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:09:11.882743 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:09:11.882709 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:09:37.289718 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:09:37.289676 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:09:49.103083 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:09:49.103047 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:10:14.682394 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:10:14.682357 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:10:25.678888 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:10:25.678807 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:10:42.365657 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:10:42.365619 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:10:53.083946 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:10:53.083905 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:11:03.468942 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:11:03.468898 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:11:13.365709 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:11:13.365676 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:11:23.267990 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:11:23.267947 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:12:48.471720 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.471683 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m"] Jul 14 19:12:48.475025 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.474999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:48.477382 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.477362 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wbx4n\"" Jul 14 19:12:48.479457 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.479435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv56p\" (UniqueName: \"kubernetes.io/projected/004be49f-644e-401a-8eb1-881d2c124c7e-kube-api-access-dv56p\") pod \"kuadrant-operator-controller-manager-86878c769f-qhr2m\" (UID: \"004be49f-644e-401a-8eb1-881d2c124c7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:48.479532 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.479465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/004be49f-644e-401a-8eb1-881d2c124c7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qhr2m\" (UID: \"004be49f-644e-401a-8eb1-881d2c124c7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:48.487220 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.487200 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m"] Jul 14 19:12:48.580645 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.580609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv56p\" (UniqueName: \"kubernetes.io/projected/004be49f-644e-401a-8eb1-881d2c124c7e-kube-api-access-dv56p\") pod \"kuadrant-operator-controller-manager-86878c769f-qhr2m\" (UID: \"004be49f-644e-401a-8eb1-881d2c124c7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:48.580865 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.580650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/004be49f-644e-401a-8eb1-881d2c124c7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qhr2m\" (UID: \"004be49f-644e-401a-8eb1-881d2c124c7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:48.581062 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.581041 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/004be49f-644e-401a-8eb1-881d2c124c7e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qhr2m\" (UID: \"004be49f-644e-401a-8eb1-881d2c124c7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:48.593576 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.593549 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv56p\" (UniqueName: \"kubernetes.io/projected/004be49f-644e-401a-8eb1-881d2c124c7e-kube-api-access-dv56p\") pod \"kuadrant-operator-controller-manager-86878c769f-qhr2m\" (UID: \"004be49f-644e-401a-8eb1-881d2c124c7e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:48.785310 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.785202 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:48.924208 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:48.923825 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m"] Jul 14 19:12:48.927095 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:12:48.927065 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004be49f_644e_401a_8eb1_881d2c124c7e.slice/crio-95dd5fbbe36a57c35df40268a5827a30d590f460bc35b4dc411c7af91f10a9c9 WatchSource:0}: Error finding container 95dd5fbbe36a57c35df40268a5827a30d590f460bc35b4dc411c7af91f10a9c9: Status 404 returned error can't find the container with id 95dd5fbbe36a57c35df40268a5827a30d590f460bc35b4dc411c7af91f10a9c9 Jul 14 19:12:49.578320 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:49.578285 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" event={"ID":"004be49f-644e-401a-8eb1-881d2c124c7e","Type":"ContainerStarted","Data":"f19f4714a745eadfb568e91b1f24b4b04e2f5abbb0508c1cb9aaebe3d5d7cd06"} Jul 14 19:12:49.578669 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:49.578371 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:12:49.578669 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:49.578389 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" event={"ID":"004be49f-644e-401a-8eb1-881d2c124c7e","Type":"ContainerStarted","Data":"95dd5fbbe36a57c35df40268a5827a30d590f460bc35b4dc411c7af91f10a9c9"} Jul 14 19:12:49.602091 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:12:49.602044 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" podStartSLOduration=1.6020302640000001 podStartE2EDuration="1.602030264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:12:49.599686806 +0000 UTC m=+1132.952510327" watchObservedRunningTime="2026-07-14 19:12:49.602030264 +0000 UTC m=+1132.954853785" Jul 14 19:13:00.585097 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:00.585062 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qhr2m" Jul 14 19:13:10.786764 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:10.786725 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:13:24.102901 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:24.102865 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:13:31.693873 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:31.693839 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:13:42.902182 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:42.902147 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:13:54.189136 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:54.189100 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:13:57.166636 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:57.166605 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:13:57.173033 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:57.173003 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:13:57.174728 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:57.174709 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:13:57.180456 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:13:57.180438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:14:05.389561 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:14:05.389525 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:14:15.090296 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:14:15.090257 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:14:26.088515 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:14:26.088479 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:14:36.587474 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:14:36.587413 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:14:45.687890 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:14:45.687853 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:14:56.500666 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:14:56.500629 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:15:20.592620 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:15:20.592583 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:15:28.794357 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:15:28.794325 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:15:37.989857 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:15:37.989809 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:15:47.300989 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:15:47.300953 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:15:59.985442 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:15:59.985407 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:16:10.500472 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:16:10.500435 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:16:21.091032 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:16:21.090929 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:16:30.290934 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:16:30.290899 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:16:40.699263 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:16:40.699197 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:16:49.889438 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:16:49.889400 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:16:58.697741 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:16:58.697703 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:17:12.597204 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:17:12.597171 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:17:21.290858 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:17:21.290812 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:17:30.508056 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:17:30.508019 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:17:43.392191 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:17:43.392147 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:17:55.889268 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:17:55.889220 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:18:05.200847 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:05.200815 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:18:16.191666 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:16.191632 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:18:27.389747 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:27.389717 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:18:40.384649 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:40.384613 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:18:53.093451 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:53.093403 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:18:57.195662 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:57.195633 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:18:57.202709 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:57.202685 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:18:57.204384 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:57.204365 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:18:57.210612 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:18:57.210594 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:19:02.095300 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:19:02.095267 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:19:11.785155 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:19:11.785111 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:19:22.888317 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:19:22.888282 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:20:32.180353 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:20:32.180320 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:20:53.684137 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:20:53.684103 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:21:53.287689 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:21:53.287655 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:22:07.498601 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:22:07.498565 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:23:11.493263 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:23:11.493217 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:23:33.999953 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:23:33.999917 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:23:57.224093 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:23:57.224063 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:23:57.231358 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:23:57.231298 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:23:57.234091 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:23:57.234072 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:23:57.240469 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:23:57.240452 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:24:44.889717 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:24:44.889679 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:26:19.793201 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:26:19.793167 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:26:27.193222 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:26:27.193184 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:26:35.886058 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:26:35.886024 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:26:46.480395 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:26:46.480357 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:27:03.286910 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:27:03.286870 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:27:44.885466 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:27:44.885427 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:27:56.693859 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:27:56.693823 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:28:15.788259 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:28:15.788202 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:28:35.786545 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:28:35.786455 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:28:57.257366 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:28:57.257337 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:28:57.264522 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:28:57.264498 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:28:57.265653 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:28:57.265630 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:28:57.272878 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:28:57.272859 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:29:32.686250 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:29:32.686201 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:29:44.182768 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:29:44.182731 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:30:35.810959 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:30:35.810925 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:30:46.996442 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:30:46.996405 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:30:56.687050 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:30:56.687007 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:31:22.119252 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:22.119190 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:31:40.134809 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.134770 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6"] Jul 14 19:31:40.138108 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.138089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" Jul 14 19:31:40.141328 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.141306 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sgh6v\"" Jul 14 19:31:40.149752 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.149731 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6"] Jul 14 19:31:40.299002 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.298964 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132cdeb7-da3f-45a3-9c9c-c754bd59dcdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6\" (UID: \"132cdeb7-da3f-45a3-9c9c-c754bd59dcdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" Jul 14 19:31:40.400475 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.400374 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132cdeb7-da3f-45a3-9c9c-c754bd59dcdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6\" (UID: \"132cdeb7-da3f-45a3-9c9c-c754bd59dcdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" Jul 14 19:31:40.401011 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.400988 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132cdeb7-da3f-45a3-9c9c-c754bd59dcdd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6\" (UID: \"132cdeb7-da3f-45a3-9c9c-c754bd59dcdd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" Jul 14 19:31:40.451497 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.451467 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" Jul 14 19:31:40.794026 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.793995 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6"] Jul 14 19:31:40.796937 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:31:40.796903 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod132cdeb7_da3f_45a3_9c9c_c754bd59dcdd.slice/crio-0fab063ede2f3f48b2ffcffa39dd69531ae19167076cd0c5cd984a4cc170727f WatchSource:0}: Error finding container 0fab063ede2f3f48b2ffcffa39dd69531ae19167076cd0c5cd984a4cc170727f: Status 404 returned error can't find the container with id 0fab063ede2f3f48b2ffcffa39dd69531ae19167076cd0c5cd984a4cc170727f Jul 14 19:31:40.798708 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:40.798692 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 19:31:41.053426 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:41.053389 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" event={"ID":"132cdeb7-da3f-45a3-9c9c-c754bd59dcdd","Type":"ContainerStarted","Data":"0fab063ede2f3f48b2ffcffa39dd69531ae19167076cd0c5cd984a4cc170727f"} Jul 14 19:31:44.071133 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:44.071095 2573 generic.go:356] "Generic (PLEG): container finished" podID="132cdeb7-da3f-45a3-9c9c-c754bd59dcdd" containerID="34527626b96c91d2e8c7e79e9366a0d7e48a7ea659c0cb2b8140b4affe37d199" exitCode=0 Jul 14 19:31:44.071567 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:44.071135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" event={"ID":"132cdeb7-da3f-45a3-9c9c-c754bd59dcdd","Type":"ContainerDied","Data":"34527626b96c91d2e8c7e79e9366a0d7e48a7ea659c0cb2b8140b4affe37d199"} Jul 14 19:31:44.332514 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:44.332475 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:31:45.212408 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:45.212383 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" Jul 14 19:31:45.344720 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:45.344641 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132cdeb7-da3f-45a3-9c9c-c754bd59dcdd-maas-api-service-ca\") pod \"132cdeb7-da3f-45a3-9c9c-c754bd59dcdd\" (UID: \"132cdeb7-da3f-45a3-9c9c-c754bd59dcdd\") " Jul 14 19:31:45.344993 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:45.344969 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/132cdeb7-da3f-45a3-9c9c-c754bd59dcdd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "132cdeb7-da3f-45a3-9c9c-c754bd59dcdd" (UID: "132cdeb7-da3f-45a3-9c9c-c754bd59dcdd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 19:31:45.445900 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:45.445863 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/132cdeb7-da3f-45a3-9c9c-c754bd59dcdd-maas-api-service-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:31:46.081949 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:46.081915 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" event={"ID":"132cdeb7-da3f-45a3-9c9c-c754bd59dcdd","Type":"ContainerDied","Data":"0fab063ede2f3f48b2ffcffa39dd69531ae19167076cd0c5cd984a4cc170727f"} Jul 14 19:31:46.082095 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:46.081969 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fab063ede2f3f48b2ffcffa39dd69531ae19167076cd0c5cd984a4cc170727f" Jul 14 19:31:46.082095 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:46.081923 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6" Jul 14 19:31:55.510227 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:31:55.510193 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:32:20.491497 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:32:20.491456 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:32:40.618512 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:32:40.618471 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:32:52.716534 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:32:52.716451 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:33:12.999137 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:33:12.999105 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:33:38.600903 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:33:38.600866 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:33:57.290035 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:33:57.290005 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:33:57.297350 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:33:57.297327 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:33:57.297587 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:33:57.297567 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:33:57.304664 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:33:57.304646 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:33:59.393364 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:33:59.393336 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:34:08.193823 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:34:08.193788 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:34:28.486912 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:34:28.486832 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:34:59.893004 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:34:59.892973 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:35:13.992449 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:35:13.992413 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:35:31.589749 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:35:31.589711 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:35:49.197822 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:35:49.197786 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:36:05.971938 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:36:05.971900 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:36:22.415624 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:36:22.415588 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:36:39.901792 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:36:39.901754 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:36:56.306525 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:36:56.306490 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:37:11.393857 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:37:11.393821 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:37:33.300917 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:37:33.300836 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:38:09.198477 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:38:09.198442 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:38:28.598730 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:38:28.598689 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:38:46.406964 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:38:46.406907 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:38:57.313806 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:38:57.313772 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:38:57.320583 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:38:57.320555 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:38:57.329199 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:38:57.329175 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:38:57.330825 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:38:57.330801 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:38:57.338159 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:38:57.338141 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56nsw_86658984-066d-4bd3-b244-f8164a16148d/ovn-acl-logging/0.log" Jul 14 19:39:44.031545 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:39:44.031505 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:40:00.203821 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:00.203784 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:40:22.208531 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:22.208452 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:40:28.765778 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.765742 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-140502278950192"] Jul 14 19:40:28.766134 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.766115 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="132cdeb7-da3f-45a3-9c9c-c754bd59dcdd" containerName="revoke-keys" Jul 14 19:40:28.766134 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.766127 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="132cdeb7-da3f-45a3-9c9c-c754bd59dcdd" containerName="revoke-keys" Jul 14 19:40:28.766215 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.766205 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="132cdeb7-da3f-45a3-9c9c-c754bd59dcdd" containerName="revoke-keys" Jul 14 19:40:28.769476 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.769456 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278950192" Jul 14 19:40:28.773354 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.773334 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4gbfx\"" Jul 14 19:40:28.778831 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.778808 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278950192"] Jul 14 19:40:28.844678 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.844641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnq68\" (UniqueName: \"kubernetes.io/projected/2ed354bc-08c1-427b-97d8-13e017d0ea43-kube-api-access-cnq68\") pod \"test-curl-7781-140502278950192\" (UID: \"2ed354bc-08c1-427b-97d8-13e017d0ea43\") " pod="opendatahub/test-curl-7781-140502278950192" Jul 14 19:40:28.945773 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.945739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnq68\" (UniqueName: \"kubernetes.io/projected/2ed354bc-08c1-427b-97d8-13e017d0ea43-kube-api-access-cnq68\") pod \"test-curl-7781-140502278950192\" (UID: \"2ed354bc-08c1-427b-97d8-13e017d0ea43\") " pod="opendatahub/test-curl-7781-140502278950192" Jul 14 19:40:28.954688 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:28.954658 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnq68\" (UniqueName: \"kubernetes.io/projected/2ed354bc-08c1-427b-97d8-13e017d0ea43-kube-api-access-cnq68\") pod \"test-curl-7781-140502278950192\" (UID: \"2ed354bc-08c1-427b-97d8-13e017d0ea43\") " pod="opendatahub/test-curl-7781-140502278950192" Jul 14 19:40:29.079700 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:29.079668 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278950192" Jul 14 19:40:29.217733 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:29.217709 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278950192"] Jul 14 19:40:29.219191 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:40:29.219162 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ed354bc_08c1_427b_97d8_13e017d0ea43.slice/crio-e986ed9afaab30aa5536483f8b15b07c1f0a685467c82142a93ad47deef673ab WatchSource:0}: Error finding container e986ed9afaab30aa5536483f8b15b07c1f0a685467c82142a93ad47deef673ab: Status 404 returned error can't find the container with id e986ed9afaab30aa5536483f8b15b07c1f0a685467c82142a93ad47deef673ab Jul 14 19:40:29.220536 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:29.220515 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 19:40:29.643966 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:29.643930 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278950192" event={"ID":"2ed354bc-08c1-427b-97d8-13e017d0ea43","Type":"ContainerStarted","Data":"e986ed9afaab30aa5536483f8b15b07c1f0a685467c82142a93ad47deef673ab"} Jul 14 19:40:30.650778 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:30.650744 2573 generic.go:356] "Generic (PLEG): container finished" podID="2ed354bc-08c1-427b-97d8-13e017d0ea43" containerID="1e647a6f60a95d5042d79f71b070bbdc4d31dd42d5c0bc5a409244c758134e5f" exitCode=0 Jul 14 19:40:30.651165 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:30.650812 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278950192" event={"ID":"2ed354bc-08c1-427b-97d8-13e017d0ea43","Type":"ContainerDied","Data":"1e647a6f60a95d5042d79f71b070bbdc4d31dd42d5c0bc5a409244c758134e5f"} Jul 14 19:40:31.789622 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:31.789600 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278950192" Jul 14 19:40:31.842430 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:31.842400 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7781-140502278950192_2ed354bc-08c1-427b-97d8-13e017d0ea43/test-curl-7781-140502278950192/0.log" Jul 14 19:40:31.871534 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:31.871504 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnq68\" (UniqueName: \"kubernetes.io/projected/2ed354bc-08c1-427b-97d8-13e017d0ea43-kube-api-access-cnq68\") pod \"2ed354bc-08c1-427b-97d8-13e017d0ea43\" (UID: \"2ed354bc-08c1-427b-97d8-13e017d0ea43\") " Jul 14 19:40:31.873612 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:31.873590 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ed354bc-08c1-427b-97d8-13e017d0ea43-kube-api-access-cnq68" (OuterVolumeSpecName: "kube-api-access-cnq68") pod "2ed354bc-08c1-427b-97d8-13e017d0ea43" (UID: "2ed354bc-08c1-427b-97d8-13e017d0ea43"). InnerVolumeSpecName "kube-api-access-cnq68". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:40:31.878553 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:31.878531 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-140502278950192"] Jul 14 19:40:31.884210 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:31.884185 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-140502278950192"] Jul 14 19:40:31.972821 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:31.972757 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnq68\" (UniqueName: \"kubernetes.io/projected/2ed354bc-08c1-427b-97d8-13e017d0ea43-kube-api-access-cnq68\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:40:32.075091 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.075052 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-140502278947120"] Jul 14 19:40:32.075478 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.075464 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed354bc-08c1-427b-97d8-13e017d0ea43" containerName="test-curl-7781-140502278950192" Jul 14 19:40:32.075527 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.075479 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed354bc-08c1-427b-97d8-13e017d0ea43" containerName="test-curl-7781-140502278950192" Jul 14 19:40:32.075563 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.075557 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ed354bc-08c1-427b-97d8-13e017d0ea43" containerName="test-curl-7781-140502278950192" Jul 14 19:40:32.078681 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.078666 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278947120" Jul 14 19:40:32.087621 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.087597 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278947120"] Jul 14 19:40:32.174340 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.174310 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhrj7\" (UniqueName: \"kubernetes.io/projected/77034116-3084-4ca5-86f6-33c99cf50ad3-kube-api-access-fhrj7\") pod \"test-curl-7781-140502278947120\" (UID: \"77034116-3084-4ca5-86f6-33c99cf50ad3\") " pod="opendatahub/test-curl-7781-140502278947120" Jul 14 19:40:32.275318 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.275225 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhrj7\" (UniqueName: \"kubernetes.io/projected/77034116-3084-4ca5-86f6-33c99cf50ad3-kube-api-access-fhrj7\") pod \"test-curl-7781-140502278947120\" (UID: \"77034116-3084-4ca5-86f6-33c99cf50ad3\") " pod="opendatahub/test-curl-7781-140502278947120" Jul 14 19:40:32.284908 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.284885 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhrj7\" (UniqueName: \"kubernetes.io/projected/77034116-3084-4ca5-86f6-33c99cf50ad3-kube-api-access-fhrj7\") pod \"test-curl-7781-140502278947120\" (UID: \"77034116-3084-4ca5-86f6-33c99cf50ad3\") " pod="opendatahub/test-curl-7781-140502278947120" Jul 14 19:40:32.388741 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.388705 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278947120" Jul 14 19:40:32.524338 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.524304 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278947120"] Jul 14 19:40:32.527592 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:40:32.527530 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77034116_3084_4ca5_86f6_33c99cf50ad3.slice/crio-38456903067c5a076a2432950d8be50c11a6cd4a8bd41291f844c1cb73347d49 WatchSource:0}: Error finding container 38456903067c5a076a2432950d8be50c11a6cd4a8bd41291f844c1cb73347d49: Status 404 returned error can't find the container with id 38456903067c5a076a2432950d8be50c11a6cd4a8bd41291f844c1cb73347d49 Jul 14 19:40:32.661582 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.661546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278947120" event={"ID":"77034116-3084-4ca5-86f6-33c99cf50ad3","Type":"ContainerStarted","Data":"38456903067c5a076a2432950d8be50c11a6cd4a8bd41291f844c1cb73347d49"} Jul 14 19:40:32.662762 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.662741 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e986ed9afaab30aa5536483f8b15b07c1f0a685467c82142a93ad47deef673ab" Jul 14 19:40:32.662843 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:32.662761 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278950192" Jul 14 19:40:32.673208 ip-10-0-131-27 kubenswrapper[2573]: E0714 19:40:32.673186 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7781-140502278950192\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="2ed354bc-08c1-427b-97d8-13e017d0ea43" pod="opendatahub/test-curl-7781-140502278950192" Jul 14 19:40:33.175667 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:33.175591 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ed354bc-08c1-427b-97d8-13e017d0ea43" path="/var/lib/kubelet/pods/2ed354bc-08c1-427b-97d8-13e017d0ea43/volumes" Jul 14 19:40:33.670309 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:33.670276 2573 generic.go:356] "Generic (PLEG): container finished" podID="77034116-3084-4ca5-86f6-33c99cf50ad3" containerID="ce98e781363b413889d96e0888fb8a7b00d39249aa1acd6308851cc617e5137d" exitCode=0 Jul 14 19:40:33.670473 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:33.670320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278947120" event={"ID":"77034116-3084-4ca5-86f6-33c99cf50ad3","Type":"ContainerDied","Data":"ce98e781363b413889d96e0888fb8a7b00d39249aa1acd6308851cc617e5137d"} Jul 14 19:40:34.810209 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:34.810185 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278947120" Jul 14 19:40:34.842163 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:34.842137 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7781-140502278947120_77034116-3084-4ca5-86f6-33c99cf50ad3/test-curl-7781-140502278947120/0.log" Jul 14 19:40:34.868258 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:34.868223 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-140502278947120"] Jul 14 19:40:34.873550 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:34.873531 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-140502278947120"] Jul 14 19:40:34.899166 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:34.899148 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhrj7\" (UniqueName: \"kubernetes.io/projected/77034116-3084-4ca5-86f6-33c99cf50ad3-kube-api-access-fhrj7\") pod \"77034116-3084-4ca5-86f6-33c99cf50ad3\" (UID: \"77034116-3084-4ca5-86f6-33c99cf50ad3\") " Jul 14 19:40:34.901194 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:34.901170 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77034116-3084-4ca5-86f6-33c99cf50ad3-kube-api-access-fhrj7" (OuterVolumeSpecName: "kube-api-access-fhrj7") pod "77034116-3084-4ca5-86f6-33c99cf50ad3" (UID: "77034116-3084-4ca5-86f6-33c99cf50ad3"). InnerVolumeSpecName "kube-api-access-fhrj7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:40:35.000600 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.000527 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhrj7\" (UniqueName: \"kubernetes.io/projected/77034116-3084-4ca5-86f6-33c99cf50ad3-kube-api-access-fhrj7\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:40:35.069776 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.069743 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:35.070122 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.070108 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77034116-3084-4ca5-86f6-33c99cf50ad3" containerName="test-curl-7781-140502278947120" Jul 14 19:40:35.070169 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.070122 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="77034116-3084-4ca5-86f6-33c99cf50ad3" containerName="test-curl-7781-140502278947120" Jul 14 19:40:35.070207 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.070198 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="77034116-3084-4ca5-86f6-33c99cf50ad3" containerName="test-curl-7781-140502278947120" Jul 14 19:40:35.073109 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.073094 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:35.084260 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.084217 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:35.176626 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.176603 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77034116-3084-4ca5-86f6-33c99cf50ad3" path="/var/lib/kubelet/pods/77034116-3084-4ca5-86f6-33c99cf50ad3/volumes" Jul 14 19:40:35.202538 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.202509 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zdw9\" (UniqueName: \"kubernetes.io/projected/865579ba-ed4d-44e5-86a8-6c9f83cfa6ac-kube-api-access-7zdw9\") pod \"test-curl-7781-140502278963248\" (UID: \"865579ba-ed4d-44e5-86a8-6c9f83cfa6ac\") " pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:35.304043 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.304013 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zdw9\" (UniqueName: \"kubernetes.io/projected/865579ba-ed4d-44e5-86a8-6c9f83cfa6ac-kube-api-access-7zdw9\") pod \"test-curl-7781-140502278963248\" (UID: \"865579ba-ed4d-44e5-86a8-6c9f83cfa6ac\") " pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:35.316681 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.316655 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zdw9\" (UniqueName: \"kubernetes.io/projected/865579ba-ed4d-44e5-86a8-6c9f83cfa6ac-kube-api-access-7zdw9\") pod \"test-curl-7781-140502278963248\" (UID: \"865579ba-ed4d-44e5-86a8-6c9f83cfa6ac\") " pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:35.382155 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.382126 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:35.517876 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.517848 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:35.520349 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:40:35.520313 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod865579ba_ed4d_44e5_86a8_6c9f83cfa6ac.slice/crio-1c4c7369e2099d87401cd878b417c07f61585e25aefa16030c1186f9efd1ffe0 WatchSource:0}: Error finding container 1c4c7369e2099d87401cd878b417c07f61585e25aefa16030c1186f9efd1ffe0: Status 404 returned error can't find the container with id 1c4c7369e2099d87401cd878b417c07f61585e25aefa16030c1186f9efd1ffe0 Jul 14 19:40:35.682195 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.682120 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278947120" Jul 14 19:40:35.682195 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.682127 2573 scope.go:117] "RemoveContainer" containerID="ce98e781363b413889d96e0888fb8a7b00d39249aa1acd6308851cc617e5137d" Jul 14 19:40:35.683565 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:35.683376 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278963248" event={"ID":"865579ba-ed4d-44e5-86a8-6c9f83cfa6ac","Type":"ContainerStarted","Data":"1c4c7369e2099d87401cd878b417c07f61585e25aefa16030c1186f9efd1ffe0"} Jul 14 19:40:36.691313 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:36.691271 2573 generic.go:356] "Generic (PLEG): container finished" podID="865579ba-ed4d-44e5-86a8-6c9f83cfa6ac" containerID="fa06529a5e9020e19d7d0d10b9115c7fea7e8bada6af78d84665ad67c36ee3e2" exitCode=0 Jul 14 19:40:36.691663 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:36.691353 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278963248" event={"ID":"865579ba-ed4d-44e5-86a8-6c9f83cfa6ac","Type":"ContainerDied","Data":"fa06529a5e9020e19d7d0d10b9115c7fea7e8bada6af78d84665ad67c36ee3e2"} Jul 14 19:40:37.836684 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:37.836662 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:37.862755 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:37.862733 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7781-140502278963248_865579ba-ed4d-44e5-86a8-6c9f83cfa6ac/test-curl-7781-140502278963248/0.log" Jul 14 19:40:37.892691 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:37.892664 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:37.898889 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:37.898867 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:37.926272 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:37.926226 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zdw9\" (UniqueName: \"kubernetes.io/projected/865579ba-ed4d-44e5-86a8-6c9f83cfa6ac-kube-api-access-7zdw9\") pod \"865579ba-ed4d-44e5-86a8-6c9f83cfa6ac\" (UID: \"865579ba-ed4d-44e5-86a8-6c9f83cfa6ac\") " Jul 14 19:40:37.928209 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:37.928188 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865579ba-ed4d-44e5-86a8-6c9f83cfa6ac-kube-api-access-7zdw9" (OuterVolumeSpecName: "kube-api-access-7zdw9") pod "865579ba-ed4d-44e5-86a8-6c9f83cfa6ac" (UID: "865579ba-ed4d-44e5-86a8-6c9f83cfa6ac"). InnerVolumeSpecName "kube-api-access-7zdw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:40:38.026724 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.026649 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:38.027057 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.027031 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zdw9\" (UniqueName: \"kubernetes.io/projected/865579ba-ed4d-44e5-86a8-6c9f83cfa6ac-kube-api-access-7zdw9\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:40:38.027156 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.027138 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865579ba-ed4d-44e5-86a8-6c9f83cfa6ac" containerName="test-curl-7781-140502278963248" Jul 14 19:40:38.027209 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.027161 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="865579ba-ed4d-44e5-86a8-6c9f83cfa6ac" containerName="test-curl-7781-140502278963248" Jul 14 19:40:38.027319 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.027306 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="865579ba-ed4d-44e5-86a8-6c9f83cfa6ac" containerName="test-curl-7781-140502278963248" Jul 14 19:40:38.030386 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.030366 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:38.039053 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.039030 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:38.127943 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.127911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5jll\" (UniqueName: \"kubernetes.io/projected/707feafa-c84f-4ad0-be0d-4f5e9066b340-kube-api-access-v5jll\") pod \"test-curl-7781-140502278963248\" (UID: \"707feafa-c84f-4ad0-be0d-4f5e9066b340\") " pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:38.229433 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.229403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5jll\" (UniqueName: \"kubernetes.io/projected/707feafa-c84f-4ad0-be0d-4f5e9066b340-kube-api-access-v5jll\") pod \"test-curl-7781-140502278963248\" (UID: \"707feafa-c84f-4ad0-be0d-4f5e9066b340\") " pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:38.239458 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.239435 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5jll\" (UniqueName: \"kubernetes.io/projected/707feafa-c84f-4ad0-be0d-4f5e9066b340-kube-api-access-v5jll\") pod \"test-curl-7781-140502278963248\" (UID: \"707feafa-c84f-4ad0-be0d-4f5e9066b340\") " pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:38.340205 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.340180 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:38.488890 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.488855 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:38.494851 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:40:38.494826 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod707feafa_c84f_4ad0_be0d_4f5e9066b340.slice/crio-06a7c3238e437ac3fa5ec86f2e02654cd29a6fa840a3bac2b7159df62f2d2217 WatchSource:0}: Error finding container 06a7c3238e437ac3fa5ec86f2e02654cd29a6fa840a3bac2b7159df62f2d2217: Status 404 returned error can't find the container with id 06a7c3238e437ac3fa5ec86f2e02654cd29a6fa840a3bac2b7159df62f2d2217 Jul 14 19:40:38.702129 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.702049 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:38.702311 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.702048 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c4c7369e2099d87401cd878b417c07f61585e25aefa16030c1186f9efd1ffe0" Jul 14 19:40:38.703214 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.703190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278963248" event={"ID":"707feafa-c84f-4ad0-be0d-4f5e9066b340","Type":"ContainerStarted","Data":"06a7c3238e437ac3fa5ec86f2e02654cd29a6fa840a3bac2b7159df62f2d2217"} Jul 14 19:40:38.713945 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.713918 2573 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7781-140502278963248" oldPodUID="865579ba-ed4d-44e5-86a8-6c9f83cfa6ac" podUID="707feafa-c84f-4ad0-be0d-4f5e9066b340" Jul 14 19:40:38.916610 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:38.916580 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:40:39.175915 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:39.175871 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="865579ba-ed4d-44e5-86a8-6c9f83cfa6ac" path="/var/lib/kubelet/pods/865579ba-ed4d-44e5-86a8-6c9f83cfa6ac/volumes" Jul 14 19:40:39.709819 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:39.709786 2573 generic.go:356] "Generic (PLEG): container finished" podID="707feafa-c84f-4ad0-be0d-4f5e9066b340" containerID="4da307eefd0c89350eb192397c1aabf506d18164844debd7a692eefb7fd0d510" exitCode=0 Jul 14 19:40:39.709988 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:39.709876 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278963248" event={"ID":"707feafa-c84f-4ad0-be0d-4f5e9066b340","Type":"ContainerDied","Data":"4da307eefd0c89350eb192397c1aabf506d18164844debd7a692eefb7fd0d510"} Jul 14 19:40:40.855315 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:40.855285 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:40.882822 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:40.882797 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7781-140502278963248_707feafa-c84f-4ad0-be0d-4f5e9066b340/test-curl-7781-140502278963248/0.log" Jul 14 19:40:40.917975 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:40.917936 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:40.924666 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:40.924641 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-140502278963248"] Jul 14 19:40:40.952111 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:40.952086 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5jll\" (UniqueName: \"kubernetes.io/projected/707feafa-c84f-4ad0-be0d-4f5e9066b340-kube-api-access-v5jll\") pod \"707feafa-c84f-4ad0-be0d-4f5e9066b340\" (UID: \"707feafa-c84f-4ad0-be0d-4f5e9066b340\") " Jul 14 19:40:40.954298 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:40.954272 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707feafa-c84f-4ad0-be0d-4f5e9066b340-kube-api-access-v5jll" (OuterVolumeSpecName: "kube-api-access-v5jll") pod "707feafa-c84f-4ad0-be0d-4f5e9066b340" (UID: "707feafa-c84f-4ad0-be0d-4f5e9066b340"). InnerVolumeSpecName "kube-api-access-v5jll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:40:41.048804 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.048770 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:41.049194 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.049174 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707feafa-c84f-4ad0-be0d-4f5e9066b340" containerName="test-curl-7781-140502278963248" Jul 14 19:40:41.049194 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.049189 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="707feafa-c84f-4ad0-be0d-4f5e9066b340" containerName="test-curl-7781-140502278963248" Jul 14 19:40:41.049363 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.049285 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="707feafa-c84f-4ad0-be0d-4f5e9066b340" containerName="test-curl-7781-140502278963248" Jul 14 19:40:41.052371 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.052353 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:41.052739 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.052713 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5jll\" (UniqueName: \"kubernetes.io/projected/707feafa-c84f-4ad0-be0d-4f5e9066b340-kube-api-access-v5jll\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:40:41.060634 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.060611 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:41.153763 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.153728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t98gx\" (UniqueName: \"kubernetes.io/projected/2e40db72-a633-46d5-8039-5c46b11aad7a-kube-api-access-t98gx\") pod \"test-curl-7781-140502278964256\" (UID: \"2e40db72-a633-46d5-8039-5c46b11aad7a\") " pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:41.176346 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.176316 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="707feafa-c84f-4ad0-be0d-4f5e9066b340" path="/var/lib/kubelet/pods/707feafa-c84f-4ad0-be0d-4f5e9066b340/volumes" Jul 14 19:40:41.254745 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.254713 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t98gx\" (UniqueName: \"kubernetes.io/projected/2e40db72-a633-46d5-8039-5c46b11aad7a-kube-api-access-t98gx\") pod \"test-curl-7781-140502278964256\" (UID: \"2e40db72-a633-46d5-8039-5c46b11aad7a\") " pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:41.270834 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.270791 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t98gx\" (UniqueName: \"kubernetes.io/projected/2e40db72-a633-46d5-8039-5c46b11aad7a-kube-api-access-t98gx\") pod \"test-curl-7781-140502278964256\" (UID: \"2e40db72-a633-46d5-8039-5c46b11aad7a\") " pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:41.362008 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.361928 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:41.528803 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.528777 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:41.530382 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:40:41.530354 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e40db72_a633_46d5_8039_5c46b11aad7a.slice/crio-039a8e1c0358a837927c1f714a908b1cd51ffa6a410ea2e6b04f423ef3534c2f WatchSource:0}: Error finding container 039a8e1c0358a837927c1f714a908b1cd51ffa6a410ea2e6b04f423ef3534c2f: Status 404 returned error can't find the container with id 039a8e1c0358a837927c1f714a908b1cd51ffa6a410ea2e6b04f423ef3534c2f Jul 14 19:40:41.722115 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.722026 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278963248" Jul 14 19:40:41.722115 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.722072 2573 scope.go:117] "RemoveContainer" containerID="4da307eefd0c89350eb192397c1aabf506d18164844debd7a692eefb7fd0d510" Jul 14 19:40:41.723409 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:41.723276 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278964256" event={"ID":"2e40db72-a633-46d5-8039-5c46b11aad7a","Type":"ContainerStarted","Data":"039a8e1c0358a837927c1f714a908b1cd51ffa6a410ea2e6b04f423ef3534c2f"} Jul 14 19:40:42.729979 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:42.729941 2573 generic.go:356] "Generic (PLEG): container finished" podID="2e40db72-a633-46d5-8039-5c46b11aad7a" containerID="65c4519843c43cda374dfb87a23e3d77733c8ab20e6aef048c08bd55d251074b" exitCode=0 Jul 14 19:40:42.730356 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:42.730022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278964256" event={"ID":"2e40db72-a633-46d5-8039-5c46b11aad7a","Type":"ContainerDied","Data":"65c4519843c43cda374dfb87a23e3d77733c8ab20e6aef048c08bd55d251074b"} Jul 14 19:40:43.873872 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:43.873846 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:43.900536 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:43.900513 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7781-140502278964256_2e40db72-a633-46d5-8039-5c46b11aad7a/test-curl-7781-140502278964256/0.log" Jul 14 19:40:43.936422 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:43.936384 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:43.939987 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:43.939957 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:43.976351 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:43.976325 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t98gx\" (UniqueName: \"kubernetes.io/projected/2e40db72-a633-46d5-8039-5c46b11aad7a-kube-api-access-t98gx\") pod \"2e40db72-a633-46d5-8039-5c46b11aad7a\" (UID: \"2e40db72-a633-46d5-8039-5c46b11aad7a\") " Jul 14 19:40:43.978398 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:43.978371 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e40db72-a633-46d5-8039-5c46b11aad7a-kube-api-access-t98gx" (OuterVolumeSpecName: "kube-api-access-t98gx") pod "2e40db72-a633-46d5-8039-5c46b11aad7a" (UID: "2e40db72-a633-46d5-8039-5c46b11aad7a"). InnerVolumeSpecName "kube-api-access-t98gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:40:44.077952 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.077911 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t98gx\" (UniqueName: \"kubernetes.io/projected/2e40db72-a633-46d5-8039-5c46b11aad7a-kube-api-access-t98gx\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:40:44.080154 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.080125 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:44.080553 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.080539 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e40db72-a633-46d5-8039-5c46b11aad7a" containerName="test-curl-7781-140502278964256" Jul 14 19:40:44.080605 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.080555 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e40db72-a633-46d5-8039-5c46b11aad7a" containerName="test-curl-7781-140502278964256" Jul 14 19:40:44.080637 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.080618 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e40db72-a633-46d5-8039-5c46b11aad7a" containerName="test-curl-7781-140502278964256" Jul 14 19:40:44.083619 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.083604 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:44.091259 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.091208 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:44.179065 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.179030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxt6\" (UniqueName: \"kubernetes.io/projected/36ba7a30-6c30-474b-a765-8a2970ecbcb6-kube-api-access-tkxt6\") pod \"test-curl-7781-140502278964256\" (UID: \"36ba7a30-6c30-474b-a765-8a2970ecbcb6\") " pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:44.280131 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.280098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxt6\" (UniqueName: \"kubernetes.io/projected/36ba7a30-6c30-474b-a765-8a2970ecbcb6-kube-api-access-tkxt6\") pod \"test-curl-7781-140502278964256\" (UID: \"36ba7a30-6c30-474b-a765-8a2970ecbcb6\") " pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:44.289867 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.289840 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxt6\" (UniqueName: \"kubernetes.io/projected/36ba7a30-6c30-474b-a765-8a2970ecbcb6-kube-api-access-tkxt6\") pod \"test-curl-7781-140502278964256\" (UID: \"36ba7a30-6c30-474b-a765-8a2970ecbcb6\") " pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:44.393374 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.393290 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:44.539922 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.539894 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:44.542036 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:40:44.542004 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36ba7a30_6c30_474b_a765_8a2970ecbcb6.slice/crio-c74af521876f9f98ab3022a027b03644cd0465abd07fe5efddaec2762f2c5c96 WatchSource:0}: Error finding container c74af521876f9f98ab3022a027b03644cd0465abd07fe5efddaec2762f2c5c96: Status 404 returned error can't find the container with id c74af521876f9f98ab3022a027b03644cd0465abd07fe5efddaec2762f2c5c96 Jul 14 19:40:44.742006 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.741918 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="039a8e1c0358a837927c1f714a908b1cd51ffa6a410ea2e6b04f423ef3534c2f" Jul 14 19:40:44.742006 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.741919 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:44.743152 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.743124 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278964256" event={"ID":"36ba7a30-6c30-474b-a765-8a2970ecbcb6","Type":"ContainerStarted","Data":"c74af521876f9f98ab3022a027b03644cd0465abd07fe5efddaec2762f2c5c96"} Jul 14 19:40:44.754596 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:44.754569 2573 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7781-140502278964256" oldPodUID="2e40db72-a633-46d5-8039-5c46b11aad7a" podUID="36ba7a30-6c30-474b-a765-8a2970ecbcb6" Jul 14 19:40:45.175861 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:45.175826 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e40db72-a633-46d5-8039-5c46b11aad7a" path="/var/lib/kubelet/pods/2e40db72-a633-46d5-8039-5c46b11aad7a/volumes" Jul 14 19:40:45.748813 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:45.748777 2573 generic.go:356] "Generic (PLEG): container finished" podID="36ba7a30-6c30-474b-a765-8a2970ecbcb6" containerID="5909a6be8fa725d5248605aa7d9e0d7be71f75928dfa06d7f530ee0ba9ba81cc" exitCode=0 Jul 14 19:40:45.748961 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:45.748860 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-140502278964256" event={"ID":"36ba7a30-6c30-474b-a765-8a2970ecbcb6","Type":"ContainerDied","Data":"5909a6be8fa725d5248605aa7d9e0d7be71f75928dfa06d7f530ee0ba9ba81cc"} Jul 14 19:40:46.896820 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:46.896796 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:46.921599 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:46.921575 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7781-140502278964256_36ba7a30-6c30-474b-a765-8a2970ecbcb6/test-curl-7781-140502278964256/0.log" Jul 14 19:40:46.946053 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:46.946026 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:46.949288 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:46.949259 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-140502278964256"] Jul 14 19:40:47.002081 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:47.002056 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkxt6\" (UniqueName: \"kubernetes.io/projected/36ba7a30-6c30-474b-a765-8a2970ecbcb6-kube-api-access-tkxt6\") pod \"36ba7a30-6c30-474b-a765-8a2970ecbcb6\" (UID: \"36ba7a30-6c30-474b-a765-8a2970ecbcb6\") " Jul 14 19:40:47.004148 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:47.004118 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36ba7a30-6c30-474b-a765-8a2970ecbcb6-kube-api-access-tkxt6" (OuterVolumeSpecName: "kube-api-access-tkxt6") pod "36ba7a30-6c30-474b-a765-8a2970ecbcb6" (UID: "36ba7a30-6c30-474b-a765-8a2970ecbcb6"). InnerVolumeSpecName "kube-api-access-tkxt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 19:40:47.102608 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:47.102573 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkxt6\" (UniqueName: \"kubernetes.io/projected/36ba7a30-6c30-474b-a765-8a2970ecbcb6-kube-api-access-tkxt6\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jul 14 19:40:47.175751 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:47.175717 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36ba7a30-6c30-474b-a765-8a2970ecbcb6" path="/var/lib/kubelet/pods/36ba7a30-6c30-474b-a765-8a2970ecbcb6/volumes" Jul 14 19:40:47.761896 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:47.761864 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-140502278964256" Jul 14 19:40:47.762063 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:40:47.761871 2573 scope.go:117] "RemoveContainer" containerID="5909a6be8fa725d5248605aa7d9e0d7be71f75928dfa06d7f530ee0ba9ba81cc" Jul 14 19:41:01.201146 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:01.201114 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:41:26.904362 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:26.904329 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-t825d"] Jul 14 19:41:45.301773 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:45.301744 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6htrt_2972a7c6-d26e-4805-ac9e-ed548616e587/manager/0.log" Jul 14 19:41:45.690767 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:45.690694 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5z2rs_f331d40e-c75a-4f55-a105-3d98c0680b83/server/0.log" Jul 14 19:41:45.958570 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:45.958500 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ff67ccb56-7t4cz_3b9311a0-9155-428a-a22e-a84ca911ed93/copy-manifests/0.log" Jul 14 19:41:45.987435 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:45.987400 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ff67ccb56-7t4cz_3b9311a0-9155-428a-a22e-a84ca911ed93/manager/0.log" Jul 14 19:41:47.582039 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:47.582010 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-76d82b-mt2q6_132cdeb7-da3f-45a3-9c9c-c754bd59dcdd/revoke-keys/0.log" Jul 14 19:41:48.433249 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:48.433209 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-rch7h_c200f637-b29a-45ca-915f-ed7d3da171a8/postgres/0.log" Jul 14 19:41:49.926043 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:49.925968 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-59hlf_8d3ecf7f-d69e-4c60-9ea9-be54b020afcf/manager/0.log" Jul 14 19:41:50.054682 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:50.054652 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mk5fm_8106d515-670e-4e64-90a7-7d92a974842e/manager/0.log" Jul 14 19:41:50.176368 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:50.176295 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nz7zq_52c66130-51eb-4f1d-8c81-3d68cdd78b69/kuadrant-console-plugin/0.log" Jul 14 19:41:50.308245 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:50.308218 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xpft7_e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d/registry-server/0.log" Jul 14 19:41:50.438322 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:50.438252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qhr2m_004be49f-644e-401a-8eb1-881d2c124c7e/manager/0.log" Jul 14 19:41:50.563282 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:50.563230 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t825d_83dddc76-f9a0-45ad-beae-c861f2c8bd9a/limitador/0.log" Jul 14 19:41:50.688994 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:50.688925 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-r7rvg_e855467b-5dbc-4ce0-93df-0eb30cf4d4fa/manager/0.log" Jul 14 19:41:51.336842 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:51.336806 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd89b4b77-8cwwm_815bb7ea-43a1-422b-b7e4-c83ace7bc24d/kube-auth-proxy/0.log" Jul 14 19:41:51.721884 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:51.721813 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qzqkt_ad7c377d-905a-414d-bc2c-f82b4e1f2c44/payload-pre-processing/0.log" Jul 14 19:41:51.846824 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:51.846796 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s5kl5_624ec147-cb80-4019-a40e-36b28bb83047/payload-processing/0.log" Jul 14 19:41:51.968157 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:51.968128 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b9c76f644-m2sfm_209d0429-de45-4ec3-b777-1d6f53a9ee4d/router/0.log" Jul 14 19:41:58.373051 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.373010 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pkg8j/must-gather-rms4k"] Jul 14 19:41:58.373485 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.373469 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36ba7a30-6c30-474b-a765-8a2970ecbcb6" containerName="test-curl-7781-140502278964256" Jul 14 19:41:58.373485 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.373486 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="36ba7a30-6c30-474b-a765-8a2970ecbcb6" containerName="test-curl-7781-140502278964256" Jul 14 19:41:58.373581 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.373571 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="36ba7a30-6c30-474b-a765-8a2970ecbcb6" containerName="test-curl-7781-140502278964256" Jul 14 19:41:58.377054 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.377035 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkg8j/must-gather-rms4k" Jul 14 19:41:58.409111 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.409091 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkg8j\"/\"kube-root-ca.crt\"" Jul 14 19:41:58.409684 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.409662 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pkg8j\"/\"default-dockercfg-bdtdn\"" Jul 14 19:41:58.412010 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.411985 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8-must-gather-output\") pod \"must-gather-rms4k\" (UID: \"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8\") " pod="openshift-must-gather-pkg8j/must-gather-rms4k" Jul 14 19:41:58.412104 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.412058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bppfz\" (UniqueName: \"kubernetes.io/projected/26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8-kube-api-access-bppfz\") pod \"must-gather-rms4k\" (UID: \"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8\") " pod="openshift-must-gather-pkg8j/must-gather-rms4k" Jul 14 19:41:58.412983 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.412967 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkg8j\"/\"openshift-service-ca.crt\"" Jul 14 19:41:58.426647 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.426625 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkg8j/must-gather-rms4k"] Jul 14 19:41:58.512992 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.512968 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8-must-gather-output\") pod \"must-gather-rms4k\" (UID: \"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8\") " pod="openshift-must-gather-pkg8j/must-gather-rms4k" Jul 14 19:41:58.513124 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.513021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bppfz\" (UniqueName: \"kubernetes.io/projected/26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8-kube-api-access-bppfz\") pod \"must-gather-rms4k\" (UID: \"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8\") " pod="openshift-must-gather-pkg8j/must-gather-rms4k" Jul 14 19:41:58.513347 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.513329 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8-must-gather-output\") pod \"must-gather-rms4k\" (UID: \"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8\") " pod="openshift-must-gather-pkg8j/must-gather-rms4k" Jul 14 19:41:58.535879 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.535852 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bppfz\" (UniqueName: \"kubernetes.io/projected/26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8-kube-api-access-bppfz\") pod \"must-gather-rms4k\" (UID: \"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8\") " pod="openshift-must-gather-pkg8j/must-gather-rms4k" Jul 14 19:41:58.685792 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.685725 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkg8j/must-gather-rms4k" Jul 14 19:41:58.859762 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:58.859735 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkg8j/must-gather-rms4k"] Jul 14 19:41:58.861413 ip-10-0-131-27 kubenswrapper[2573]: W0714 19:41:58.861379 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26bb96aa_3cd3_40b1_b9ce_b1ad07562eb8.slice/crio-ca6f1037dfe5852176ed5346f662294fd59fd92c779c9572b2d79572306448ae WatchSource:0}: Error finding container ca6f1037dfe5852176ed5346f662294fd59fd92c779c9572b2d79572306448ae: Status 404 returned error can't find the container with id ca6f1037dfe5852176ed5346f662294fd59fd92c779c9572b2d79572306448ae Jul 14 19:41:59.125047 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:41:59.125013 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkg8j/must-gather-rms4k" event={"ID":"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8","Type":"ContainerStarted","Data":"ca6f1037dfe5852176ed5346f662294fd59fd92c779c9572b2d79572306448ae"} Jul 14 19:42:00.132751 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:00.132664 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkg8j/must-gather-rms4k" event={"ID":"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8","Type":"ContainerStarted","Data":"8c4c061bee84e0611b90e62a20c264be7d426d8e78db401bef79fefdd5ef489e"} Jul 14 19:42:00.132751 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:00.132711 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkg8j/must-gather-rms4k" event={"ID":"26bb96aa-3cd3-40b1-b9ce-b1ad07562eb8","Type":"ContainerStarted","Data":"fdd45fe36af63f2ebccc4b412bca96dbdcb615336a880806e179e5b4d921fdba"} Jul 14 19:42:00.152581 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:00.152516 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pkg8j/must-gather-rms4k" podStartSLOduration=1.148722224 podStartE2EDuration="2.152492897s" totalImagesPullingTime="1.003770673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 19:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:00.15066327 +0000 UTC m=+2883.503486791" watchObservedRunningTime="2026-07-14 19:42:00.152492897 +0000 UTC m=+2883.505316419" Jul 14 19:42:01.846331 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:01.846302 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5nq78_38cbc3f4-e252-4f0c-a155-5b9bcc9ca86f/global-pull-secret-syncer/0.log" Jul 14 19:42:02.064198 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:02.064167 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pglv2_b83fd31e-62ad-48d1-ba43-164ba56d677a/konnectivity-agent/0.log" Jul 14 19:42:02.089513 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:02.089479 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-27.ec2.internal_b4ea88a121a641dae990504772a5f753/haproxy/0.log" Jul 14 19:42:07.341725 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:07.341686 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-59hlf_8d3ecf7f-d69e-4c60-9ea9-be54b020afcf/manager/0.log" Jul 14 19:42:07.389920 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:07.389886 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mk5fm_8106d515-670e-4e64-90a7-7d92a974842e/manager/0.log" Jul 14 19:42:07.427452 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:07.427422 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nz7zq_52c66130-51eb-4f1d-8c81-3d68cdd78b69/kuadrant-console-plugin/0.log" Jul 14 19:42:07.482889 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:07.482836 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xpft7_e45c9546-6ecf-46bb-8e2b-8ff6cfefab2d/registry-server/0.log" Jul 14 19:42:07.704676 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:07.704595 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qhr2m_004be49f-644e-401a-8eb1-881d2c124c7e/manager/0.log" Jul 14 19:42:07.737666 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:07.737643 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-t825d_83dddc76-f9a0-45ad-beae-c861f2c8bd9a/limitador/0.log" Jul 14 19:42:07.828368 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:07.828330 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-r7rvg_e855467b-5dbc-4ce0-93df-0eb30cf4d4fa/manager/0.log" Jul 14 19:42:09.745637 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:09.745586 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-xqxx8_fa09d2f0-fb0d-4c1d-a6fd-ce5c66d96605/cluster-monitoring-operator/0.log" Jul 14 19:42:10.146620 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:10.146593 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srqcb_ad038775-73c3-45c1-a5c9-d6cf8eb627e5/node-exporter/0.log" Jul 14 19:42:10.177400 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:10.177370 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srqcb_ad038775-73c3-45c1-a5c9-d6cf8eb627e5/kube-rbac-proxy/0.log" Jul 14 19:42:10.212041 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:10.212016 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-srqcb_ad038775-73c3-45c1-a5c9-d6cf8eb627e5/init-textfile/0.log" Jul 14 19:42:11.577296 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.577255 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b"] Jul 14 19:42:11.580665 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.580639 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.592447 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.592392 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b"] Jul 14 19:42:11.657844 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.656403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-lib-modules\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.657844 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.656558 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-sys\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.657844 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.656596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-proc\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.657844 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.656715 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvjx7\" (UniqueName: \"kubernetes.io/projected/4daf7651-8150-439c-9439-e5c092a68935-kube-api-access-hvjx7\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.657844 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.656759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-podres\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757229 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757186 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-sys\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757429 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-proc\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757429 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757295 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvjx7\" (UniqueName: \"kubernetes.io/projected/4daf7651-8150-439c-9439-e5c092a68935-kube-api-access-hvjx7\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757429 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-podres\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757429 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-lib-modules\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757649 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757491 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-lib-modules\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757649 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757540 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-sys\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757649 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757571 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-proc\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.757856 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.757821 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4daf7651-8150-439c-9439-e5c092a68935-podres\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.766710 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.766676 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvjx7\" (UniqueName: \"kubernetes.io/projected/4daf7651-8150-439c-9439-e5c092a68935-kube-api-access-hvjx7\") pod \"perf-node-gather-daemonset-hvx5b\" (UID: \"4daf7651-8150-439c-9439-e5c092a68935\") " pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:11.893818 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:11.893725 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:12.095256 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:12.094885 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b"] Jul 14 19:42:12.180012 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:12.179986 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-8mkx4_e8503de4-812a-4304-a9ac-1418472d5ea9/networking-console-plugin/0.log" Jul 14 19:42:12.238254 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:12.238016 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" event={"ID":"4daf7651-8150-439c-9439-e5c092a68935","Type":"ContainerStarted","Data":"6d9a46c61bf6e8d89b042c4d8547cc96f4831e602a62de590ee8fb24b3e9878d"} Jul 14 19:42:12.778713 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:12.778678 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/1.log" Jul 14 19:42:12.784935 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:12.784909 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-899pv_ee55fd33-7c23-4f00-8a6e-2ad4eb600f7a/console-operator/2.log" Jul 14 19:42:13.246413 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:13.246373 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" event={"ID":"4daf7651-8150-439c-9439-e5c092a68935","Type":"ContainerStarted","Data":"d9caa63511c34297b900ff8f36e43308e0ea786d13d2a1c4b4d1c75d26396f9a"} Jul 14 19:42:13.246862 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:13.246834 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:13.267787 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:13.267727 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" podStartSLOduration=2.267706647 podStartE2EDuration="2.267706647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 19:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 19:42:13.265694449 +0000 UTC m=+2896.618517972" watchObservedRunningTime="2026-07-14 19:42:13.267706647 +0000 UTC m=+2896.620530171" Jul 14 19:42:13.436047 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:13.436017 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-dhvsl_cf151b45-69c0-4b3d-a825-99ab17f1a217/download-server/0.log" Jul 14 19:42:14.063692 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:14.063666 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-ks9fg_e96a5b4a-3b87-4724-bff6-d6cb6c8a087e/volume-data-source-validator/0.log" Jul 14 19:42:15.363884 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:15.363859 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4wpdm_99a6be85-dd78-4145-910f-50e264877d17/dns/0.log" Jul 14 19:42:15.420652 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:15.420627 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4wpdm_99a6be85-dd78-4145-910f-50e264877d17/kube-rbac-proxy/0.log" Jul 14 19:42:15.738301 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:15.738209 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jbdkb_3d421be0-d91a-41c1-b8e0-ec2205fe6be4/dns-node-resolver/0.log" Jul 14 19:42:16.538223 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:16.538195 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qtf7j_fe5424b3-5c95-41a1-a9f0-ec481c863c63/node-ca/0.log" Jul 14 19:42:17.955739 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:17.955705 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd89b4b77-8cwwm_815bb7ea-43a1-422b-b7e4-c83ace7bc24d/kube-auth-proxy/0.log" Jul 14 19:42:18.122452 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:18.122421 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qzqkt_ad7c377d-905a-414d-bc2c-f82b4e1f2c44/payload-pre-processing/0.log" Jul 14 19:42:18.160845 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:18.160811 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s5kl5_624ec147-cb80-4019-a40e-36b28bb83047/payload-processing/0.log" Jul 14 19:42:18.186608 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:18.186580 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b9c76f644-m2sfm_209d0429-de45-4ec3-b777-1d6f53a9ee4d/router/0.log" Jul 14 19:42:18.999507 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:18.999475 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mrx77_750a0fb6-f2ad-41b9-a9a9-a2fca77081c4/serve-healthcheck-canary/0.log" Jul 14 19:42:19.265905 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:19.265833 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pkg8j/perf-node-gather-daemonset-hvx5b" Jul 14 19:42:19.518251 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:19.518049 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-skc5m_23510c14-feb5-41ec-8400-8f8fbd8df57e/insights-operator/0.log" Jul 14 19:42:19.519261 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:19.519215 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-skc5m_23510c14-feb5-41ec-8400-8f8fbd8df57e/insights-operator/1.log" Jul 14 19:42:19.732139 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:19.732109 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk9z6_ae95650b-5ed5-4a6b-bc9d-51290c403544/kube-rbac-proxy/0.log" Jul 14 19:42:19.757735 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:19.757709 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk9z6_ae95650b-5ed5-4a6b-bc9d-51290c403544/exporter/0.log" Jul 14 19:42:19.790903 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:19.790840 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk9z6_ae95650b-5ed5-4a6b-bc9d-51290c403544/extractor/0.log" Jul 14 19:42:22.180792 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:22.180753 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd89b4b77-8cwwm_815bb7ea-43a1-422b-b7e4-c83ace7bc24d/kube-auth-proxy/0.log" Jul 14 19:42:22.287195 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:22.287168 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-6htrt_2972a7c6-d26e-4805-ac9e-ed548616e587/manager/0.log" Jul 14 19:42:22.302431 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:22.302400 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qzqkt_ad7c377d-905a-414d-bc2c-f82b4e1f2c44/payload-pre-processing/0.log" Jul 14 19:42:22.332490 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:22.332450 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s5kl5_624ec147-cb80-4019-a40e-36b28bb83047/payload-processing/0.log" Jul 14 19:42:22.350955 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:22.350918 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b9c76f644-m2sfm_209d0429-de45-4ec3-b777-1d6f53a9ee4d/router/0.log" Jul 14 19:42:22.620295 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:22.620260 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5z2rs_f331d40e-c75a-4f55-a105-3d98c0680b83/server/0.log" Jul 14 19:42:22.825169 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:22.825137 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ff67ccb56-7t4cz_3b9311a0-9155-428a-a22e-a84ca911ed93/manager/0.log" Jul 14 19:42:22.848574 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:22.848552 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ff67ccb56-7t4cz_3b9311a0-9155-428a-a22e-a84ca911ed93/copy-manifests/0.log" Jul 14 19:42:23.828314 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:23.828286 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd89b4b77-8cwwm_815bb7ea-43a1-422b-b7e4-c83ace7bc24d/kube-auth-proxy/0.log" Jul 14 19:42:23.957662 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:23.957581 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-qzqkt_ad7c377d-905a-414d-bc2c-f82b4e1f2c44/payload-pre-processing/0.log" Jul 14 19:42:23.980134 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:23.980105 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-s5kl5_624ec147-cb80-4019-a40e-36b28bb83047/payload-processing/0.log" Jul 14 19:42:23.994265 ip-10-0-131-27 kubenswrapper[2573]: I0714 19:42:23.994225 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b9c76f644-m2sfm_209d0429-de45-4ec3-b777-1d6f53a9ee4d/router/0.log"